00000001:02000400:3.0F:1787579143.978807:0:2975:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg653-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1787579166.268878:0:3195:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg653-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1787579169.603342:0:3256:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 653 MB/s 00000001:01000000:2.0:1787579169.855169:0:3256:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 353 MB/s 00000001:01000000:0.0:1787579170.105806:0:3256:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3139 MB/s 00000020:02000000:0.0:1787579170.819362:0:3288:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_80_g35a8f2d 00000400:02000000:1.0F:1787579171.672789:0:3303:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.206.153@tcp [8/256/0/180] 00008000:02000000:1.0:1787579176.120240:0:3453:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1787579240.838518:0:5260:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg653-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787579252.091326:0:5846:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787579252.091331:0:5846:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1787579252.091458:0:5846:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000096e6aa8e 00000080:02000400:1.0:1787579252.091468:0:5846:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1787579252.096482:0:5846:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1787579252.096494:0:5846:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787579252.096527:0:5846:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000008c7fb3eb) 00000020:00000080:1.0:1787579252.096546:0:5846:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787579252.110011:0:5846:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787579252.110395:0:5846:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787579252.129413:0:5846:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787579252.129449:0:5846:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787579252.129470:0:5846:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787579252.129520:0:5846:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787579252.129546:0:5846:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787579252.130848:0:5846:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787579252.130872:0:5846:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787579252.136379:0:5846:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb72beeaffa1b6a19 00000020:01000004:0.0:1787579252.136396:0:5846:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1787579252.136402:0:5846:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787579252.136413:0:5846:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000096e6aa8e from MGS 00000020:01000004:0.0:1787579252.136417:0:5846:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787579252.136452:0:5846:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000063c51338) 00000020:00000080:0.0:1787579252.136468:0:5846:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787579252.136556:0:5846:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000096e6aa8e from MGS, refs=2 00080000:01000000:0.0:1787579252.136563:0:5846:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787579252.136572:0:5846:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb72beeaffa1b6a27 00000100:00100000:0.0:1787579252.136888:0:5846:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787579252.137046:0:5846:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787579252.137051:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787579252.139803:0:5846:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787579252.139817:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787579252.140777:0:5846:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787579252.141075:0:5846:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787579252.141081:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787579252.141577:0:5846:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787579252.141584:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787579252.142197:0:5846:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787579252.142208:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787579252.143169:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579252.143173:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579252.143175:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579252.143513:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579252.143517:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579252.143518:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579252.144109:0:5846:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787579252.147261:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787579252.393798:0:5846:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3331 MB/s 00000001:01000000:1.0:1787579252.643550:0:5846:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 1695 MB/s 00000001:01000000:3.0:1787579252.895607:0:5846:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 452 MB/s 00000001:01000000:2.0:1787579253.145289:0:5846:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 459 MB/s 00010000:00010000:2.0:1787579253.152818:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1787579253.165897:0:5846:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1787579253.190803:0:5846:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1787579253.190818:0:5846:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787579253.190821:0:5846:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1787579253.196735:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787579253.196831:0:5846:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787579253.196893:0:5846:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1787579253.198697:0:5846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787579253.198735:0:5846:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787579253.200691:0:5846:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787579253.200849:0:5846:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787579253.200856:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787579253.202672:0:5846:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787579253.202681:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787579253.203439:0:5846:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787579253.203446:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787579253.204036:0:5846:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787579253.204056:0:5846:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.153@tcp' 00000020:01000004:0.0:1787579253.204057:0:5846:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787579253.204109:0:5846:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.153@tcp (typ=mgc) 00000020:00000080:0.0:1787579253.204120:0:5846:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.153@tcp (00000000418fec4e) 00000020:00000080:0.0:1787579253.204134:0:5846:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787579253.204203:0:5846:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003daeb84e@MGC192.168.206.153@tcp: add connection 192.168.206.153@tcp at head 00000100:00080000:3.0:1787579253.204454:0:5862:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:0.0:1787579253.205437:0:5846:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.153@tcp-0 is initialized 00000040:01000000:0.0:1787579253.205444:0:5846:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.153@tcp ctxt 1 is initialized 10000000:01000000:3.0:1787579253.209425:0:5863:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787579253.209511:0:5846:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.153@tcp (uuid 58d0ce6f-950d-4003-ac33-0f50e03ceaf8) 00000020:00000080:0.0:1787579253.209532:0:5846:0:(genops.c:1385:class_connect()) connect: client 58d0ce6f-950d-4003-ac33-0f50e03ceaf8, cookie 0xb72beeaffa1b6a35 00000100:00080000:0.0:1787579253.209542:0:5846:0:(import.c:510:import_select_connection()) MGC192.168.206.153@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787579253.209548:0:5846:0:(import.c:624:import_select_connection()) MGC192.168.206.153@tcp: import 000000003daeb84e using connection 192.168.206.153@tcp/0@lo 00000100:00100000:0.0:1787579253.209587:0:5846:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000074424a46 x1874412616810624/t0(0) o250->MGC192.168.206.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787579253.209621:0:5846:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 58d0ce6f-950d-4003-ac33-0f50e03ceaf8->MGS 00000020:01000004:0.0:1787579253.209637:0:5846:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787579253.209642:0:5846:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787579253.209654:0:5846:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000006d59442c) 00000020:00000080:0.0:1787579253.209666:0:5846:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787579253.210140:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000074424a46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3318:1874412616810624:0@lo:250: 00000100:00100000:3.0:1787579253.210201:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579253.210699:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616810624 00000100:00100000:1.0:1787579253.210707:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616810624 00000100:00100000:1.0:1787579253.210753:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787579253.210759:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001478b4ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3318:x1874412616810624:12345-0@lo:250: 00010000:00080000:1.0:1787579253.210779:0:5859:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 58d0ce6f-950d-4003-ac33-0f50e03ceaf8@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:1.0:1787579253.210799:0:5859:0:(genops.c:1385:class_connect()) connect: client 58d0ce6f-950d-4003-ac33-0f50e03ceaf8, cookie 0xb72beeaffa1b6a43 00000100:00080000:1.0:1787579253.213462:0:5859:0:(import.c:65:import_set_state_nolock()) 000000008c3bbc0f : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787579253.213566:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001478b4ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+5:3318:x1874412616810624:12345-0@lo:250: Request processed in 2803us (3362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579253.213577:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787579253.213626:0:3318:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.153@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787579253.213634:0:3318:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.153@tcp: connect to target with instance 0 00000100:00080000:1.0:1787579253.213641:0:3318:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.153@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787579253.213646:0:3318:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787579253.213649:0:3318:0:(import.c:65:import_set_state_nolock()) 000000003daeb84e MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787579253.213651:0:3318:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787579253.213659:0:3318:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787579253.213670:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000074424a46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3318:1874412616810624:0@lo:250: 00000100:00100000:0.0:1787579253.234826:0:5846:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787579253.235397:0:5846:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787579253.235404:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787579253.236477:0:5846:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787579253.236486:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787579253.236855:0:5846:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787579253.236871:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787579253.238388:0:5846:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787579253.238549:0:5846:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787579253.238555:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787579253.242578:0:5846:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787579253.242591:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787579253.301522:0:5846:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787579253.301824:0:5846:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787579253.301831:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787579253.304456:0:5846:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787579253.304469:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787579253.305559:0:5846:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787579253.305890:0:5846:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787579253.305897:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787579253.306783:0:5846:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787579253.306790:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787579253.307830:0:5846:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787579253.308191:0:5846:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787579253.308196:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787579253.309487:0:5846:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787579253.309497:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787579253.310696:0:5846:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787579253.311383:0:5846:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787579253.311390:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787579253.312133:0:5846:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787579253.312140:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787579253.352695:0:5846:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787579253.353481:0:5846:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787579253.353490:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787579253.362157:0:5846:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787579253.362172:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787579253.364239:0:5846:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787579253.364250:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787579253.369769:0:5846:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787579253.369808:0:5846:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787579253.369813:0:5846:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.153@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787579253.369988:0:5846:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.153@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787579253.370021:0:5846:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.153@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787579253.370025:0:5846:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787579253.370026:0:5846:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787579253.370027:0:5846:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787579253.370028:0:5846:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787579253.370029:0:5846:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787579253.370030:0:5846:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787579253.370032:0:5846:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787579253.370033:0:5846:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787579253.370034:0:5846:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787579253.370035:0:5846:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787579253.370041:0:5846:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787579253.370042:0:5846:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787579253.370044:0:5846:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787579253.370046:0:5846:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787579253.370047:0:5846:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787579253.370048:0:5846:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787579253.370049:0:5846:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787579253.370050:0:5846:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787579253.370051:0:5846:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787579253.370051:0:5846:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787579253.370052:0:5846:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787579253.370053:0:5846:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787579253.370054:0:5846:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787579253.370055:0:5846:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787579253.370055:0:5846:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787579253.370092:0:5846:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787579253.370109:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000667e776f pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616810752:0@lo:253: 00000100:00100000:2.0:1787579253.370746:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579253.370906:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 0000000007f34c76 going to sleep for 11 seconds 00000100:00100000:3.0:1787579253.370911:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616810752 00000100:00100000:3.0:1787579253.370918:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616810752 00000100:00100000:3.0:1787579253.371011:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787579253.371020:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056c7dfbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+5:5846:x1874412616810752:12345-0@lo:253: 20000000:01000000:3.0:1787579253.371064:0:5861:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787579253.371067:0:5861:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1787579253.371492:0:5882:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787579253.371607:0:5861:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1787579253.371833:0:5861:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787579253.383506:0:5883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1787579253.388903:0:5861:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787579253.388911:0:5861:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1787579253.388917:0:5861:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1787579253.388920:0:5861:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1787579253.388952:0:5861:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1787579253.389233:0:5861:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787579253.389890:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1787579253.389905:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787579253.389975:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1787579253.390025:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1787579253.390064:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1787579253.390277:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1787579253.390287:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1787579253.390560:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1787579253.390570:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1787579253.390834:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1787579253.390844:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1787579253.390894:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1787579253.390970:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1787579253.391014:0:5861:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787579253.391020:0:5861:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1787579253.391033:0:5861:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787579253.391790:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1787579253.391802:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787579253.391840:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1787579253.391887:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1787579253.391961:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1787579253.391974:0:5861:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1787579253.392056:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1787579253.392064:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787579253.392112:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1787579253.392227:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1787579253.392265:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1787579253.392276:0:5861:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1787579253.393057:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1787579253.393069:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1787579253.393105:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1787579253.393209:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1787579253.393610:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1787579253.393661:0:5861:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787579253.393668:0:5861:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1787579253.398803:0:5884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1787579253.399457:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1787579253.399483:0:5861:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.153@tcp for mdt 20000000:01000000:2.0:1787579253.399485:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.153@tcp (null) (null) (null) 00000040:00080000:2.0:1787579253.399537:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1787579253.399547:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787579253.399580:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1787579253.399588:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.153@tcp (null) (null) 00000040:00080000:2.0:1787579253.399633:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1787579253.399643:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787579253.399676:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1787579253.399713:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1787579253.399776:0:5861:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787579253.399779:0:5861:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787579253.399783:0:5861:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787579253.399794:0:5861:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787579253.402505:0:5885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1787579253.405677:0:5861:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1787579253.416866:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1787579253.416922:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1787579253.417599:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1787579253.417619:0:5861:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787579253.417622:0:5861:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787579253.417625:0:5861:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787579253.417702:0:5861:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787579253.417705:0:5861:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787579253.417735:0:5861:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787579253.417737:0:5861:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787579253.418342:0:5886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1787579253.418606:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1787579253.418725:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1787579253.418787:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:1.0:1787579253.418802:0:5861:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787579253.418803:0:5861:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787579253.419513:0:5887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1787579253.419819:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1787579253.419877:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1787579253.419915:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1787579253.420119:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787579253.420122:0:5861:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:1.0:1787579253.420128:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787579253.420147:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000037afc952/0xb72beeaffa1b6a4a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579253.420162:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000037afc952/0xb72beeaffa1b6a4a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579253.420171:0:5861:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000037afc952/0xb72beeaffa1b6a4a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579253.420286:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000037afc952/0xb72beeaffa1b6a4a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579253.420293:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000037afc952/0xb72beeaffa1b6a4a lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579253.420299:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000037afc952/0xb72beeaffa1b6a4a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579253.420305:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000037afc952 already unused, calling callback (00000000e3311356) 00010000:00010000:1.0:1787579253.420308:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000037afc952/0xb72beeaffa1b6a4a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579253.420365:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000037afc952/0xb72beeaffa1b6a4a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579253.420378:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000037afc952/0xb72beeaffa1b6a4a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579253.420385:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000037afc952/0xb72beeaffa1b6a4a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579253.420390:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000037afc952/0xb72beeaffa1b6a4a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787579253.420406:0:5861:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787579253.642704:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056c7dfbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+5:5846:x1874412616810752:12345-0@lo:253: Request processed in 271679us (271952us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579253.642723:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787579253.642876:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000667e776f pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616810752:0@lo:253: 10000000:01000000:2.0:1787579253.642891:0:5846:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787579253.642895:0:5846:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787579253.642897:0:5846:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787579253.642898:0:5846:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787579253.642899:0:5846:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1787579253.642901:0:5846:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787579253.642902:0:5846:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787579253.642903:0:5846:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787579253.642904:0:5846:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787579253.642905:0:5846:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787579253.642906:0:5846:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787579253.642907:0:5846:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787579253.642923:0:5846:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000096e6aa8e from lustre-MDT0000 10000000:01000000:2.0:1787579253.642969:0:5846:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787579253.642971:0:5846:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787579253.642977:0:5846:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffffa0ce98720000 10000000:01000000:2.0:1787579253.642980:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787579253.642987:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa0ce98720000 from 1 10000000:01000000:2.0:1787579253.642989:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787579253.643021:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: 00000000b9caa563/0xb72beeaffa1b6a51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579253.643031:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: 00000000b9caa563/0xb72beeaffa1b6a51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579253.643039:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: 00000000b9caa563/0xb72beeaffa1b6a51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579253.643054:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000667e776f pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616810880:0@lo:101: 00000100:00100000:2.0:1787579253.643086:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579253.643151:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aa66dcab going to sleep for 11 seconds 00000100:00100000:1.0:1787579253.643205:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616810880 00000100:00100000:1.0:1787579253.643212:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616810880 00000100:00100000:1.0:1787579253.643253:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787579253.643262:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7cc5fc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+5:5846:x1874412616810880:12345-0@lo:101: 00010000:00010000:1.0:1787579253.643282:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579253.643293:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000037afc952/0xb72beeaffa1b6a58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6a51 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579253.643313:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000037afc952/0xb72beeaffa1b6a58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6a51 expref: 6 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579253.643322:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000037afc952/0xb72beeaffa1b6a58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6a51 expref: 6 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579253.643330:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000037afc952, rc 0) 00000100:00100000:1.0:1787579253.643363:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7cc5fc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+6:5846:x1874412616810880:12345-0@lo:101: Request processed in 102us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579253.643369:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787579253.643479:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000667e776f pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616810880:0@lo:101: 00010000:00010000:0.0:1787579253.643490:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: 00000000b9caa563/0xb72beeaffa1b6a51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6a58 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579253.643498:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: 00000000b9caa563/0xb72beeaffa1b6a51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6a58 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579253.643538:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d1e47aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616811008:0@lo:501: 00000100:00100000:0.0:1787579253.643575:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579253.643597:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 000000009be714cd going to sleep for 11 seconds 00000100:00100000:2.0:1787579253.643656:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616811008 00000100:00100000:2.0:1787579253.643660:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616811008 00000100:00100000:2.0:1787579253.643700:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787579253.643706:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006231367c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+6:5846:x1874412616811008:12345-0@lo:501: 00000100:00100000:2.0:1787579253.643915:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006231367c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+6:5846:x1874412616811008:12345-0@lo:501: Request processed in 209us (339us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787579253.643923:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787579253.644095:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d1e47aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616811008:0@lo:501: 10000000:01000000:0.0:1787579253.644119:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787579253.644135:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: 00000000b9caa563/0xb72beeaffa1b6a51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6a58 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579253.644143:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: 00000000b9caa563/0xb72beeaffa1b6a51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6a58 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579253.644151:0:5846:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0ce90be4800 10000000:01000000:0.0:1787579253.644156:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787579253.644159:0:5846:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffffa0ce90be4800 10000000:01000000:0.0:1787579253.644162:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787579253.644164:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffffa0ce90be4800 from 1 10000000:01000000:0.0:1787579253.644166:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787579253.644188:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: 000000007b00b06a/0xb72beeaffa1b6a5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579253.644195:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: 000000007b00b06a/0xb72beeaffa1b6a5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579253.644201:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: 000000007b00b06a/0xb72beeaffa1b6a5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579253.644213:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d1e47aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616811136:0@lo:101: 00000100:00100000:0.0:1787579253.644240:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579253.644264:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 000000009be714cd going to sleep for 11 seconds 00000100:00100000:2.0:1787579253.644361:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616811136 00000100:00100000:2.0:1787579253.644366:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616811136 00000100:00100000:2.0:1787579253.644394:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787579253.644401:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa43b1c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+6:5846:x1874412616811136:12345-0@lo:101: 00010000:00010000:2.0:1787579253.644408:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579253.644419:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000066e9ce5b/0xb72beeaffa1b6a66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6a5f expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579253.644432:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000066e9ce5b/0xb72beeaffa1b6a66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6a5f expref: 7 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579253.644441:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000066e9ce5b/0xb72beeaffa1b6a66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6a5f expref: 7 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579253.644447:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000066e9ce5b, rc 0) 00000100:00100000:2.0:1787579253.644523:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa43b1c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+7:5846:x1874412616811136:12345-0@lo:101: Request processed in 123us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579253.644528:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787579253.644731:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d1e47aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616811136:0@lo:101: 00010000:00010000:1.0:1787579253.644742:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: 000000007b00b06a/0xb72beeaffa1b6a5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6a66 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579253.644750:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: 000000007b00b06a/0xb72beeaffa1b6a5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6a66 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579253.644761:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787579253.644817:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: 000000007b00b06a/0xb72beeaffa1b6a5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6a66 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579253.644823:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: 000000007b00b06a/0xb72beeaffa1b6a5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6a66 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579253.644830:0:5846:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787579253.644839:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787579253.644843:0:5846:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffffa0ce90be4800 10000000:01000000:1.0:1787579253.644846:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787579253.644849:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787579253.644851:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787579253.644887:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: 00000000ca0f52fe/0xb72beeaffa1b6a6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579253.644895:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: 00000000ca0f52fe/0xb72beeaffa1b6a6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579253.644901:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: 00000000ca0f52fe/0xb72beeaffa1b6a6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579253.644913:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ec28326a pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616811264:0@lo:101: 00000100:00100000:1.0:1787579253.644973:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579253.644990:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 00000000755ec3d5 going to sleep for 11 seconds 00000100:00100000:0.0:1787579253.645044:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616811264 00000100:00100000:0.0:1787579253.645049:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616811264 00000100:00100000:0.0:1787579253.645080:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787579253.645086:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000443c732f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+7:5846:x1874412616811264:12345-0@lo:101: 00010000:00010000:0.0:1787579253.645093:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579253.645100:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000014c42319/0xb72beeaffa1b6a74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6a6d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579253.645113:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000014c42319/0xb72beeaffa1b6a74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6a6d expref: 8 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579253.645120:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000014c42319/0xb72beeaffa1b6a74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6a6d expref: 8 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579253.645125:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000014c42319, rc 0) 00000100:00100000:0.0:1787579253.645160:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000443c732f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+8:5846:x1874412616811264:12345-0@lo:101: Request processed in 75us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579253.645166:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787579253.645247:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ec28326a pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616811264:0@lo:101: 00010000:00010000:1.0:1787579253.645257:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: 00000000ca0f52fe/0xb72beeaffa1b6a6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6a74 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579253.645263:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: 00000000ca0f52fe/0xb72beeaffa1b6a6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6a74 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579253.645300:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ec28326a pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616811392:0@lo:501: 00000100:00100000:1.0:1787579253.645323:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579253.645342:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 00000000755ec3d5 going to sleep for 11 seconds 00000100:00100000:0.0:1787579253.645389:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616811392 00000100:00100000:0.0:1787579253.645393:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616811392 00000100:00100000:0.0:1787579253.645420:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787579253.645427:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a410d174 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+8:5846:x1874412616811392:12345-0@lo:501: 00000100:00100000:0.0:1787579253.645624:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a410d174 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+9:5846:x1874412616811392:12345-0@lo:501: Request processed in 198us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579253.645644:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787579253.645837:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ec28326a pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616811392:0@lo:501: 00000100:00100000:1.0:1787579253.645874:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ec28326a pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616811520:0@lo:503: 00000100:00100000:1.0:1787579253.645916:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579253.645963:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 00000000755ec3d5 going to sleep for 11 seconds 00000100:00100000:2.0:1787579253.646020:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616811520 00000100:00100000:2.0:1787579253.646025:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616811520 00000100:00100000:2.0:1787579253.646056:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787579253.646062:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a315ddf9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+9:5846:x1874412616811520:12345-0@lo:503: 00000100:00100000:2.0:1787579253.646199:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a315ddf9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+9:5846:x1874412616811520:12345-0@lo:503: Request processed in 137us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579253.646205:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787579253.646287:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ec28326a pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616811520:0@lo:503: 00000100:00100000:1.0:1787579253.646674:0:5889:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ec28326a pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5889:1874412616811648:0@lo:502: 00000100:00100000:1.0:1787579253.646710:0:5889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579253.646731:0:5889:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c47055f2 going to sleep for 11 seconds 00000100:00100000:2.0:1787579253.646835:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616811648 00000100:00100000:2.0:1787579253.646839:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616811648 00000100:00100000:2.0:1787579253.646874:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787579253.646880:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb1ac15e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+9:5889:x1874412616811648:12345-0@lo:502: 00000100:00100000:2.0:1787579253.647054:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb1ac15e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+9:5889:x1874412616811648:12345-0@lo:502: Request processed in 173us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579253.647061:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787579253.647140:0:5889:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ec28326a pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5889:1874412616811648:0@lo:502: 00000020:01000000:0.0:1787579253.647161:0:5889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787579253.647171:0:5889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579253.647173:0:5889:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787579253.647177:0:5889:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787579253.647181:0:5889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787579253.647192:0:5889:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000029dbfff0) 00000020:00000080:0.0:1787579253.647211:0:5889:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787579253.647217:0:5889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787579253.647281:0:5889:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787579253.647287:0:5889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb72beeaffa1b6a82 00000020:00000080:0.0:1787579253.647496:0:5889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787579253.647501:0:5889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787579253.647505:0:5889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579253.647506:0:5889:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787579253.647509:0:5889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787579253.647512:0:5889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579253.647513:0:5889:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787579253.647516:0:5889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787579253.647529:0:5889:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000086a93790) 00000020:00000080:0.0:1787579253.647540:0:5889:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787579253.647544:0:5889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787579253.647546:0:5889:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787579253.647548:0:5889:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787579253.647559:0:5889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787579253.647596:0:5889:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000096e6aa8e from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787579253.647608:0:5889:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000004f2d677c) 00000020:00000080:0.0:1787579253.647616:0:5889:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787579253.647685:0:5889:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787579253.647691:0:5889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb72beeaffa1b6a97 00000020:00000080:0.0:1787579253.647772:0:5889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787579253.647777:0:5889:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787579253.647782:0:5889:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xb72beeaffa1b6a9e 00080000:01000000:0.0:1787579253.647786:0:5889:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787579253.647790:0:5889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb72beeaffa1b6aa5 00080000:10000000:0.0:1787579253.648166:0:5889:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1787579253.648350:0:5889:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1787579253.655954:0:5889:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1787579253.733694:0:5889:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1787579253.734342:0:5889:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1787579253.736253:0:5889:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1787579253.736484:0:5889:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787579253.827623:0:5889:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000cfc2079d) 00000020:00000080:2.0:1787579253.832258:0:5889:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787579253.832523:0:5889:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787579253.832531:0:5889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb72beeaffa1b6ab3 00000020:00000080:2.0:1787579253.835507:0:5889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1787579253.848471:0:5889:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787579253.877208:0:5889:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787579253.919043:0:5889:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787579253.957796:0:5889:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787579254.032241:0:5889:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787579254.057639:0:5889:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1787579254.080052:0:5889:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xb72beeaffa1b6aba 00000020:00000080:1.0:1787579254.080413:0:5889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787579254.080425:0:5889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787579254.080431:0:5889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579254.080433:0:5889:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787579254.080436:0:5889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787579254.080441:0:5889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579254.080442:0:5889:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787579254.080446:0:5889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787579254.080501:0:5889:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787579254.080519:0:5889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787579254.080522:0:5889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579254.080523:0:5889:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787579254.080526:0:5889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787579254.080528:0:5889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579254.080529:0:5889:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787579254.080531:0:5889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787579254.080533:0:5889:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787579254.080571:0:5889:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002960886e pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5889:1874412616811776:0@lo:502: 00000100:00100000:1.0:1787579254.080648:0:5889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579254.080692:0:5889:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d3c684fa going to sleep for 11 seconds 00000100:00100000:3.0:1787579254.080751:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616811776 00000100:00100000:3.0:1787579254.080758:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616811776 00000100:00100000:3.0:1787579254.080805:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787579254.080812:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e1136a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+9:5889:x1874412616811776:12345-0@lo:502: 00000100:00100000:3.0:1787579254.081172:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e1136a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+9:5889:x1874412616811776:12345-0@lo:502: Request processed in 360us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579254.081180:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787579254.081227:0:5889:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002960886e pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5889:1874412616811776:0@lo:502: 00000020:01000000:3.0:1787579254.081250:0:5889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787579254.081254:0:5889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579254.081256:0:5889:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787579254.081259:0:5889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1787579254.081823:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1787579254.081839:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787579254.081897:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: 00000000ca0f52fe/0xb72beeaffa1b6a6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6a74 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579254.081908:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: 00000000ca0f52fe/0xb72beeaffa1b6a6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6a74 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579254.081915:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0ce90be4800 from 1 10000000:01000000:2.0:1787579254.081918:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787579254.081964:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: 00000000a1fba64e/0xb72beeaffa1b6ac1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579254.081971:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: 00000000a1fba64e/0xb72beeaffa1b6ac1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579254.081991:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: 00000000a1fba64e/0xb72beeaffa1b6ac1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579254.082006:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000037b64152 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616811904:0@lo:101: 00000100:00100000:2.0:1787579254.082043:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579254.082073:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f534f8f8 going to sleep for 11 seconds 00000100:00100000:1.0:1787579254.082122:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616811904 00000100:00100000:1.0:1787579254.082127:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616811904 00000100:00100000:1.0:1787579254.082155:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787579254.082161:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d51edae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+9:5846:x1874412616811904:12345-0@lo:101: 00010000:00010000:1.0:1787579254.082176:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579254.082186:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000ced1f81/0xb72beeaffa1b6ac8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6ac1 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579254.082204:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000ced1f81/0xb72beeaffa1b6ac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6ac1 expref: 10 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579254.082213:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000ced1f81/0xb72beeaffa1b6ac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6ac1 expref: 10 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579254.082221:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000ced1f81, rc 0) 00000100:00100000:1.0:1787579254.082257:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d51edae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+10:5846:x1874412616811904:12345-0@lo:101: Request processed in 97us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579254.082264:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787579254.082332:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000037b64152 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616811904:0@lo:101: 00010000:00010000:2.0:1787579254.082343:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: 00000000a1fba64e/0xb72beeaffa1b6ac1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6ac8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579254.082351:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: 00000000a1fba64e/0xb72beeaffa1b6ac1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6ac8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579254.082891:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000037b64152 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616812032:0@lo:256: 00000100:00100000:2.0:1787579254.082949:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579254.082969:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f534f8f8 going to sleep for 11 seconds 00000100:00100000:1.0:1787579254.083161:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616812032 00000100:00100000:1.0:1787579254.083166:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616812032 00000100:00100000:1.0:1787579254.083190:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787579254.083196:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de07ace9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+10:5846:x1874412616812032:12345-0@lo:256: 20000000:01000000:1.0:1787579254.083209:0:5860:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787579254.083214:0:5860:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787579254.083274:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de07ace9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+10:5846:x1874412616812032:12345-0@lo:256: Request processed in 78us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579254.083281:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787579254.083466:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000037b64152 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616812032:0@lo:256: 10000000:01000000:2.0:1787579254.084145:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787579254.084265:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: 00000000a1fba64e/0xb72beeaffa1b6ac1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6ac8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579254.084276:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: 00000000a1fba64e/0xb72beeaffa1b6ac1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6ac8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579254.084284:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0ce90be4800 from 1 10000000:01000000:2.0:1787579254.084287:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787579254.084317:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: 00000000ea668463/0xb72beeaffa1b6acf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579254.084324:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: 00000000ea668463/0xb72beeaffa1b6acf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579254.084332:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: 00000000ea668463/0xb72beeaffa1b6acf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579254.084345:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000037b64152 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616812160:0@lo:101: 00000100:00100000:2.0:1787579254.084380:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579254.084407:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f534f8f8 going to sleep for 11 seconds 00000100:00100000:1.0:1787579254.084458:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616812160 00000100:00100000:1.0:1787579254.084464:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616812160 00000100:00100000:1.0:1787579254.084494:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787579254.084500:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000969fe2a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+10:5846:x1874412616812160:12345-0@lo:101: 00010000:00010000:1.0:1787579254.084509:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579254.084525:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f6effe6b/0xb72beeaffa1b6ad6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6acf expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579254.084543:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f6effe6b/0xb72beeaffa1b6ad6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6acf expref: 11 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579254.084553:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f6effe6b/0xb72beeaffa1b6ad6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6acf expref: 11 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579254.084560:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f6effe6b, rc 0) 00000100:00100000:1.0:1787579254.084597:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000969fe2a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+11:5846:x1874412616812160:12345-0@lo:101: Request processed in 97us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579254.084603:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787579254.084723:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000037b64152 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616812160:0@lo:101: 00010000:00010000:0.0:1787579254.084734:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: 00000000ea668463/0xb72beeaffa1b6acf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6ad6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579254.084742:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: 00000000ea668463/0xb72beeaffa1b6acf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6ad6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579254.084782:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000091285e2c pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616812288:0@lo:501: 00000100:00100000:0.0:1787579254.084813:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579254.084835:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d95918e5 going to sleep for 11 seconds 00000100:00100000:1.0:1787579254.084885:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616812288 00000100:00100000:1.0:1787579254.084889:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616812288 00000100:00100000:1.0:1787579254.084915:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787579254.084920:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000088105e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+11:5846:x1874412616812288:12345-0@lo:501: 00000100:00100000:1.0:1787579254.085392:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000088105e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+11:5846:x1874412616812288:12345-0@lo:501: Request processed in 471us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579254.085400:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787579254.085528:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000091285e2c pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616812288:0@lo:501: 00000100:00100000:3.0:1787579254.085569:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000030e3c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616812416:0@lo:503: 00000100:00100000:3.0:1787579254.085602:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579254.085694:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 0000000024184387 going to sleep for 11 seconds 00000100:00100000:1.0:1787579254.085731:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616812416 00000100:00100000:1.0:1787579254.085736:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616812416 00000100:00100000:1.0:1787579254.085791:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787579254.085798:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf679383 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+11:5846:x1874412616812416:12345-0@lo:503: 00000040:00080000:1.0:1787579254.085828:0:5861:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787579254.085878:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf679383 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+11:5846:x1874412616812416:12345-0@lo:503: Request processed in 81us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579254.085885:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787579254.085955:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000030e3c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616812416:0@lo:503: 00000040:00080000:3.0:1787579254.086677:0:5893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1787579254.086718:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787579254.086731:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787579254.086739:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: 00000000ea668463/0xb72beeaffa1b6acf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6ad6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579254.086749:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: 00000000ea668463/0xb72beeaffa1b6acf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6ad6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579254.086782:0:5846:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787579254.086785:0:5846:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0ce90be4800 10000000:01000000:3.0:1787579254.086788:0:5846:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0ce90be4800 10000000:01000000:3.0:1787579254.086797:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787579254.086801:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0ce90be4800 from 1 10000000:01000000:3.0:1787579254.086804:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787579254.086825:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: 000000009b8f890d/0xb72beeaffa1b6add lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579254.086832:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: 000000009b8f890d/0xb72beeaffa1b6add lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579254.086840:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: 000000009b8f890d/0xb72beeaffa1b6add lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579254.086865:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000030e3c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616812544:0@lo:101: 00000100:00100000:3.0:1787579254.086898:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579254.087216:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a9bc6732 going to sleep for 11 seconds 00000100:00100000:0.0:1787579254.087303:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616812544 00000100:00100000:0.0:1787579254.087309:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616812544 00000100:00100000:0.0:1787579254.087335:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787579254.087341:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056423d76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+11:5846:x1874412616812544:12345-0@lo:101: 00010000:00010000:0.0:1787579254.087350:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579254.087360:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e47d41f3/0xb72beeaffa1b6ae4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6add expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579254.087381:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e47d41f3/0xb72beeaffa1b6ae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6add expref: 12 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579254.087389:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e47d41f3/0xb72beeaffa1b6ae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6add expref: 12 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579254.087397:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e47d41f3, rc 0) 00000100:00100000:0.0:1787579254.087468:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056423d76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:5846:x1874412616812544:12345-0@lo:101: Request processed in 127us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579254.087474:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787579254.087585:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000030e3c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616812544:0@lo:101: 00010000:00010000:3.0:1787579254.087596:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: 000000009b8f890d/0xb72beeaffa1b6add lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6ae4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579254.087604:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: 000000009b8f890d/0xb72beeaffa1b6add lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6ae4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579254.087705:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000030e3c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616812672:0@lo:501: 00000100:00100000:3.0:1787579254.087729:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579254.087776:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a9bc6732 going to sleep for 11 seconds 00000100:00100000:0.0:1787579254.087803:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616812672 00000100:00100000:0.0:1787579254.087807:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616812672 00000100:00100000:0.0:1787579254.087871:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787579254.087877:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000385f3d8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:5846:x1874412616812672:12345-0@lo:501: 00000100:00100000:0.0:1787579254.088186:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000385f3d8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:5846:x1874412616812672:12345-0@lo:501: Request processed in 309us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579254.088194:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787579254.088247:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000030e3c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616812672:0@lo:501: 00000100:00100000:3.0:1787579254.088272:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000030e3c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616812800:0@lo:503: 00000100:00100000:3.0:1787579254.088306:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579254.088428:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a9bc6732 going to sleep for 11 seconds 00000100:00100000:2.0:1787579254.088479:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616812800 00000100:00100000:2.0:1787579254.088484:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616812800 00000100:00100000:3.0:1787579254.088621:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787579254.088727:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000740c3a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:5846:x1874412616812800:12345-0@lo:503: 00000100:00100000:3.0:1787579254.089045:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000740c3a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:5846:x1874412616812800:12345-0@lo:503: Request processed in 321us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579254.089053:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787579254.089130:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000030e3c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616812800:0@lo:503: 00000100:00100000:2.0:1787579254.089436:0:5894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000065c95544 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5894:1874412616812928:0@lo:502: 00000100:00100000:2.0:1787579254.089472:0:5894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579254.089500:0:5894:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fc2907bf going to sleep for 11 seconds 00000100:00100000:0.0:1787579254.089545:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616812928 00000100:00100000:0.0:1787579254.089549:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616812928 00000100:00100000:0.0:1787579254.089578:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787579254.089584:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007513a503 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:5894:x1874412616812928:12345-0@lo:502: 00000100:00100000:0.0:1787579254.089776:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007513a503 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:5894:x1874412616812928:12345-0@lo:502: Request processed in 192us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579254.089783:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787579254.089951:0:5894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000065c95544 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5894:1874412616812928:0@lo:502: 00000020:01000004:2.0:1787579254.090000:0:5894:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787579254.090013:0:5894:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000eb9c20b0) 00000020:00000080:2.0:1787579254.090029:0:5894:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1787579254.090132:0:5894:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000096e6aa8e from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787579254.090136:0:5894:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000096e6aa8e from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787579254.090138:0:5894:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000096e6aa8e 4 00010000:00080000:2.0:1787579254.090162:0:5894:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f5db342d@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.153@tcp at head 00010000:00010000:0.0:1787579254.092491:0:5894:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1787579254.092730:0:5894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787579254.092762:0:5894:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787579254.092773:0:5894:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xb72beeaffa1b6af2 00000100:00080000:0.0:1787579254.092781:0:5894:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787579254.092786:0:5894:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f5db342d using connection 192.168.206.153@tcp/0@lo 00000100:00100000:0.0:1787579254.092815:0:5894:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000017051796 x1874412616813056/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787579254.092840:0:5894:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787579254.093094:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017051796 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874412616813056:0@lo:38: 00000100:00100000:1.0:1787579254.093158:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579254.093238:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616813056 00000100:00100000:0.0:1787579254.093245:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616813056 00000100:00100000:0.0:1787579254.093304:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787579254.093310:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f29b71d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3318:x1874412616813056:12345-0@lo:38: 00000100:00100000:0.0:1787579254.093356:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f29b71d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3318:x1874412616813056:12345-0@lo:38: Request processed in 46us (199us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787579254.093363:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787579254.097119:0:3318:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787579254.097130:0:3318:0:(import.c:65:import_set_state_nolock()) 00000000f5db342d lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787579254.097138:0:3318:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787579254.097142:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017051796 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874412616813056:0@lo:38: 00000100:00100000:0.0:1787579254.097267:0:5894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017051796 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5894:1874412616813184:0@lo:502: 00000100:00100000:0.0:1787579254.097328:0:5894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579254.097370:0:5894:0:(client.c:2715:ptlrpc_set_wait()) set 000000003dff800e going to sleep for 11 seconds 00000100:00100000:1.0:1787579254.097522:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616813184 00000100:00100000:1.0:1787579254.097529:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616813184 00000100:00100000:1.0:1787579254.097571:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787579254.097579:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001409820a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:5894:x1874412616813184:12345-0@lo:502: 00000100:00100000:1.0:1787579254.097804:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001409820a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:5894:x1874412616813184:12345-0@lo:502: Request processed in 226us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579254.097811:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787579254.098166:0:5894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017051796 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5894:1874412616813184:0@lo:502: 00000040:00080000:0.0:1787579254.098189:0:5894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1787579254.098299:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787579254.098318:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787579254.098336:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: 000000009b8f890d/0xb72beeaffa1b6add lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6ae4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579254.098346:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: 000000009b8f890d/0xb72beeaffa1b6add lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6ae4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787579254.098383:0:5846:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787579254.098386:0:5846:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787579254.098387:0:5846:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787579254.098388:0:5846:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787579254.098389:0:5846:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787579254.098391:0:5846:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787579254.098392:0:5846:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787579254.098393:0:5846:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787579254.098395:0:5846:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787579254.098396:0:5846:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787579254.098397:0:5846:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787579254.098399:0:5846:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787579254.098401:0:5846:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787579254.098404:0:5846:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787579254.098405:0:5846:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787579254.098406:0:5846:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787579254.098407:0:5846:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787579254.098412:0:5846:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787579254.098413:0:5846:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787579254.098413:0:5846:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787579254.098414:0:5846:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787579254.098415:0:5846:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787579254.098416:0:5846:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787579254.098417:0:5846:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787579254.098418:0:5846:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787579254.098432:0:5846:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787579254.098440:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c350817f pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616813312:0@lo:253: 00000100:00100000:1.0:1787579254.098473:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579254.098499:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 00000000622ab291 going to sleep for 11 seconds 00000100:00100000:0.0:1787579254.098572:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616813312 00000100:00100000:0.0:1787579254.098578:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616813312 00000100:00100000:0.0:1787579254.098607:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787579254.098614:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d22dd9be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:5846:x1874412616813312:12345-0@lo:253: 20000000:01000000:0.0:1787579254.098658:0:5861:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787579254.098670:0:5861:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787579254.131890:0:5861:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787579254.131951:0:5861:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787579254.136400:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d22dd9be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:5846:x1874412616813312:12345-0@lo:253: Request processed in 37780us (37920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579254.136414:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787579254.136473:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c350817f pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5846:1874412616813312:0@lo:253: 10000000:01000000:1.0:1787579254.136487:0:5846:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787579254.136490:0:5846:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787579254.136491:0:5846:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787579254.136493:0:5846:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787579254.136494:0:5846:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787579254.136495:0:5846:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787579254.136496:0:5846:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787579254.136498:0:5846:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787579254.136499:0:5846:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787579254.136500:0:5846:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787579254.136501:0:5846:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787579254.136503:0:5846:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787579254.136504:0:5846:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787579254.136515:0:5846:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1787579254.142031:0:5882:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787579254.142040:0:5882:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787579254.142140:0:5882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e5278296/0xb72beeaffa1b6af9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579254.142168:0:5882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000ced1f81/0xb72beeaffa1b6ac8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6ac1 expref: 11 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579254.142177:0:5882:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e5278296/0xb72beeaffa1b6af9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579254.142219:0:5882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000ced1f81/0xb72beeaffa1b6ac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b6ac1 expref: 11 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579254.142234:0:5882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000ced1f81/0xb72beeaffa1b6ac8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b6ac1 expref: 11 pid: 5859 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579254.142247:0:5882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017051796 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5882:1874412616813440:0@lo:104: 00000100:00100000:0.0:1787579254.142308:0:5882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579254.142366:0:5882:0:(client.c:2715:ptlrpc_set_wait()) set 00000000843b8e74 going to sleep for 11 seconds 00000100:00100000:2.0:1787579254.142510:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616813440 00000100:00100000:2.0:1787579254.142518:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616813440 00000100:00100000:2.0:1787579254.142568:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787579254.142583:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eeaa2257 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+3:5882:x1874412616813440:12345-0@lo:104: 00010000:00010000:2.0:1787579254.142707:0:5848:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: 00000000a1fba64e/0xb72beeaffa1b6ac1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6ac8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579254.142767:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787579254.142772:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eeaa2257 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+3:5882:x1874412616813440:12345-0@lo:104: Request processed in 191us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579254.142779:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787579254.142951:0:5882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017051796 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5882:1874412616813440:0@lo:104: 00010000:00010000:0.0:1787579254.142967:0:5882:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e5278296/0xb72beeaffa1b6af9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579254.143897:0:5853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787579254.143904:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: 00000000a1fba64e/0xb72beeaffa1b6ac1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6ac8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579254.144039:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a1fba64e already unused, calling callback (000000008e307a40) 10000000:00010000:1.0:1787579254.144042:0:5853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: 00000000a1fba64e/0xb72beeaffa1b6ac1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b6ac8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579254.144050:0:5853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: 00000000a1fba64e/0xb72beeaffa1b6ac1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b6ac8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787579254.144056:0:5853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: 00000000a1fba64e/0xb72beeaffa1b6ac1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b6ac8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579254.144062:0:5853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787579254.144092:0:5853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: 00000000a1fba64e/0xb72beeaffa1b6ac1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6ac8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579254.144098:0:5853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787579254.144192:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c350817f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616813568:0@lo:103: 00000100:00100000:3.0:1787579254.144236:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787579254.144351:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: 00000000a1fba64e/0xb72beeaffa1b6ac1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6ac8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579254.144359:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: 00000000a1fba64e/0xb72beeaffa1b6ac1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6ac8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579254.144376:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579254.144378:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579254.144380:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579254.144634:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616813568 00000100:00100000:0.0:1787579254.144641:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616813568 00010000:00010000:0.0:1787579254.144664:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000ced1f81/0xb72beeaffa1b6ac8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6ac1 expref: 12 pid: 5859 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579254.144690:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787579254.144696:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003994c188 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:3320:x1874412616813568:12345-0@lo:103: 00010000:00010000:0.0:1787579254.144707:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579254.144712:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000ced1f81/0xb72beeaffa1b6ac8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6ac1 expref: 12 pid: 5859 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579254.144721:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000ced1f81/0xb72beeaffa1b6ac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b6ac1 expref: 12 pid: 5859 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579254.144733:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000ced1f81/0xb72beeaffa1b6ac8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b6ac1 expref: 12 pid: 5859 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579254.144745:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e5278296/0xb72beeaffa1b6af9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579254.144752:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e5278296/0xb72beeaffa1b6af9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787579254.144764:0:5850:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002724517s 00010000:00010000:0.0:1787579254.144768:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e5278296/0xb72beeaffa1b6af9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579254.144784:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e5278296/0xb72beeaffa1b6af9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579254.144790:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e5278296/0xb72beeaffa1b6af9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579254.144795:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e5278296/0xb72beeaffa1b6af9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579254.144801:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e5278296 already unused, calling callback (00000000e3311356) 00010000:00010000:0.0:1787579254.144804:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e5278296/0xb72beeaffa1b6af9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579254.144809:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e5278296/0xb72beeaffa1b6af9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579254.144822:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e5278296/0xb72beeaffa1b6af9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579254.144831:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579254.148165:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003994c188 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+11:3320:x1874412616813568:12345-0@lo:103: Request processed in 3462us (3922us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579254.148179:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787579254.148223:0:5882:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e5278296/0xb72beeaffa1b6af9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579254.148232:0:5882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e5278296/0xb72beeaffa1b6af9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579254.148238:0:5882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e5278296/0xb72beeaffa1b6af9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579254.148339:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c350817f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616813568:0@lo:103: 00080000:10000000:1.0:1787579254.149872:0:5846:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787579254.150354:0:5846:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787579254.150542:0:5846:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787579254.150748:0:5846:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787579254.150919:0:5846:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787579254.151223:0:5846:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1787579254.152058:0:5846:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1787579254.152235:0:5846:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1787579254.152414:0:5846:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1787579254.152544:0:5846:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1787579254.152718:0:5846:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1787579254.152898:0:5846:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1787579254.174687:0:5846:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00010000:00010000:2.0:1787579254.179266:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787579254.215497:0:5846:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787579254.215796:0:5899:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1787579254.215800:0:5899:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1787579254.215969:0:5900:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787579254.221565:0:5846:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787579254.221810:0:5846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787579254.222576:0:5846:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787579254.222586:0:5846:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787579254.222959:0:5846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787579254.226388:0:5846:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787579254.227583:0:5846:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787579254.227844:0:5846:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787579254.229298:0:5846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787579254.229602:0:5846:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1787579254.240521:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1787579254.240680:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1787579254.240822:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1787579254.240997:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1787579254.241135:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1787579254.241274:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1787579254.241418:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1787579254.241558:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1787579254.241685:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1787579254.241817:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1787579254.242000:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1787579254.242129:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1787579254.242274:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1787579254.242468:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1787579254.242612:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1787579254.256029:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787579254.256295:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1787579254.256433:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1787579254.256876:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787579254.257045:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787579254.257167:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787579254.257293:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1787579254.257418:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1787579254.258994:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1787579254.259234:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1787579254.259389:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1787579254.259692:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1787579254.259823:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1787579254.259992:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1787579254.260122:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787579254.260741:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787579254.260959:0:5846:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787579254.261146:0:5846:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1787579254.294905:0:5900:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1787579254.336178:0:5846:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787579254.336211:0:5846:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaf09c1cef988 00100000:10000000:2.0:1787579254.336219:0:5846:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787579254.337179:0:5846:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787579254.337191:0:5846:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.153@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787579254.337202:0:5846:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787579254.337222:0:5846:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1787579254.340466:0:5900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787579254.340530:0:5900:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787579254.340535:0:5900:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1787579255.201106:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579256.227528:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579257.249095:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579258.280672:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787579258.739475:0:6142:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg653-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:0.0:1787579258.848757:0:5863:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787579258.848763:0:5863:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0ce90be4800 from 3 10000000:01000000:0.0:1787579258.848766:0:5863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787579258.848804:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: 00000000e5278296/0xb72beeaffa1b6b00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579258.848814:0:5863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: 00000000e5278296/0xb72beeaffa1b6b00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579258.848825:0:5863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: 00000000e5278296/0xb72beeaffa1b6b00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579258.848855:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017051796 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616813696:0@lo:101: 00000100:00100000:0.0:1787579258.848912:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579258.848966:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set 00000000843b8e74 going to sleep for 11 seconds 00000100:00100000:2.0:1787579258.849783:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616813696 00000100:00100000:2.0:1787579258.849792:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616813696 00000100:00100000:2.0:1787579258.849886:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787579258.849895:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014818d07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+11:5863:x1874412616813696:12345-0@lo:101: 00010000:00010000:2.0:1787579258.849908:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579258.849922:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000042e1069a/0xb72beeaffa1b6b07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6b00 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579258.849964:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000042e1069a/0xb72beeaffa1b6b07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6b00 expref: 12 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579258.849974:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000042e1069a/0xb72beeaffa1b6b07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6b00 expref: 12 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579258.849992:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000042e1069a, rc 0) 00000100:00100000:2.0:1787579258.850041:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014818d07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:5863:x1874412616813696:12345-0@lo:101: Request processed in 149us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579258.850048:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787579258.851643:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017051796 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616813696:0@lo:101: 00010000:00010000:1.0:1787579258.851666:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: 00000000e5278296/0xb72beeaffa1b6b00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6b07 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579258.851682:0:5863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: 00000000e5278296/0xb72beeaffa1b6b00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6b07 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579258.851738:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f461957a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616813824:0@lo:256: 00000100:00100000:1.0:1787579258.851784:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579258.859710:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d8f5a3ac going to sleep for 11 seconds 00000100:00100000:0.0:1787579258.859993:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616813824 00000100:00100000:0.0:1787579258.860003:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616813824 00000100:00100000:0.0:1787579258.860128:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787579258.860136:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d3dd879 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:5863:x1874412616813824:12345-0@lo:256: 20000000:01000000:0.0:1787579258.860171:0:5860:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787579258.860184:0:5860:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787579258.860187:0:5860:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787579258.860292:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d3dd879 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:5863:x1874412616813824:12345-0@lo:256: Request processed in 158us (8508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579258.860299:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787579258.861344:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f461957a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616813824:0@lo:256: 10000000:01000000:0.0:1787579258.861400:0:5863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787579258.861407:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: 00000000e5278296/0xb72beeaffa1b6b00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6b07 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579258.861416:0:5863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: 00000000e5278296/0xb72beeaffa1b6b00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6b07 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579259.296133:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787579259.370051:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787579259.370060:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787579259.370063:0:479:0:(import.c:65:import_set_state_nolock()) 00000000f5db342d lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787579259.370075:0:479:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f5db342d using connection 192.168.206.153@tcp/0@lo 00000100:00100000:2.0:1787579259.370109:0:479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000065c95544 x1874412616813952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787579259.373358:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000065c95544 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874412616813952:0@lo:38: 00000100:00100000:0.0:1787579259.373479:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579259.373720:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616813952 00000100:00100000:3.0:1787579259.373727:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616813952 00000100:00100000:3.0:1787579259.373773:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787579259.373780:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d7d263d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3318:x1874412616813952:12345-0@lo:38: 00010000:00080000:3.0:1787579259.373803:0:5868:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:3.0:1787579259.373848:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xb72beeaffa1b6b0e 00000004:00100000:3.0:1787579259.373887:0:5868:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787579259.374016:0:5868:0:(import.c:65:import_set_state_nolock()) 000000006f2c9d38 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787579259.374070:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d7d263d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874412616813952:12345-0@lo:38: Request processed in 290us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579259.374078:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787579259.375363:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000065c95544 x1874412616813952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787579269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787579259.375380:0:3318:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787579259.375387:0:3318:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787579259.375391:0:3318:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787579259.375394:0:3318:0:(import.c:65:import_set_state_nolock()) 00000000f5db342d lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787579259.375400:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000065c95544 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874412616813952:0@lo:38: 00010000:00010000:0.0:1787579260.323174:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579261.346719:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579262.368062:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579263.392095:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787579263.493227:0:6344:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc767ff690 20000000:00000080:3.0:1787579263.493242:0:6344:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0cec11c7400 uarg=0000000000000000 20000000:01000000:3.0:1787579263.493276:0:6344:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787579263.493287:0:6344:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787579263.493291:0:6344:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787579263.493462:0:6344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1787579263.493473:0:6344:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1787579263.497257:0:6344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787579263.497468:0:6344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787579263.497516:0:6344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1787579263.497562:0:6344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1787579263.498028:0:6344:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787579263.498044:0:6344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000500b57eb/0xb72beeaffa1b6b15 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579263.498061:0:6344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f6effe6b/0xb72beeaffa1b6ad6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6acf expref: 11 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579263.498069:0:6344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000500b57eb/0xb72beeaffa1b6b15 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579263.498100:0:6344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f6effe6b/0xb72beeaffa1b6ad6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b6acf expref: 11 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579263.498112:0:6344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f6effe6b/0xb72beeaffa1b6ad6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b6acf expref: 11 pid: 5860 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579263.498124:0:6344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000010572ce6 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6344:1874412616814080:0@lo:104: 00000100:00100000:3.0:1787579263.498173:0:6344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579263.498206:0:6344:0:(client.c:2715:ptlrpc_set_wait()) set 000000001e0a77e2 going to sleep for 11 seconds 00000100:00100000:0.0:1787579263.498263:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616814080 00000100:00100000:0.0:1787579263.498275:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616814080 00000100:00100000:0.0:1787579263.498342:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787579263.498349:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c93f1402 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+3:6344:x1874412616814080:12345-0@lo:104: 00010000:00010000:0.0:1787579263.498359:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: 00000000ea668463/0xb72beeaffa1b6acf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6ad6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579263.498408:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787579263.498412:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c93f1402 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+3:6344:x1874412616814080:12345-0@lo:104: Request processed in 64us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579263.498419:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787579263.498476:0:6344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000010572ce6 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6344:1874412616814080:0@lo:104: 00010000:00010000:3.0:1787579263.498490:0:6344:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000500b57eb/0xb72beeaffa1b6b15 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579263.499917:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787579263.500160:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: 00000000ea668463/0xb72beeaffa1b6acf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6ad6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579263.500171:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ea668463 already unused, calling callback (000000008e307a40) 10000000:00010000:0.0:1787579263.500173:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: 00000000ea668463/0xb72beeaffa1b6acf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b6ad6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579263.500181:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: 00000000ea668463/0xb72beeaffa1b6acf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b6ad6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787579263.500187:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: 00000000ea668463/0xb72beeaffa1b6acf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b6ad6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579263.500193:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787579263.500270:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: 00000000ea668463/0xb72beeaffa1b6acf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6ad6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579263.500276:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787579263.500305:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: 00000000ea668463/0xb72beeaffa1b6acf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6ad6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579263.500319:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: 00000000ea668463/0xb72beeaffa1b6acf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6ad6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579263.500335:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579263.500336:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579263.500338:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579263.500422:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ad8d280a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616814208:0@lo:103: 00000100:00100000:3.0:1787579263.500476:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579263.500605:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616814208 00000100:00100000:0.0:1787579263.500612:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616814208 00010000:00010000:0.0:1787579263.500634:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f6effe6b/0xb72beeaffa1b6ad6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6acf expref: 12 pid: 5860 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579263.500668:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787579263.500676:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010572ce6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:3321:x1874412616814208:12345-0@lo:103: 00010000:00010000:0.0:1787579263.500685:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579263.500690:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f6effe6b/0xb72beeaffa1b6ad6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6acf expref: 12 pid: 5860 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579263.500700:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f6effe6b/0xb72beeaffa1b6ad6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b6acf expref: 12 pid: 5860 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579263.500712:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f6effe6b/0xb72beeaffa1b6ad6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b6acf expref: 12 pid: 5860 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579263.500723:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000500b57eb/0xb72beeaffa1b6b15 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579263.500730:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000500b57eb/0xb72beeaffa1b6b15 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579263.500912:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000500b57eb/0xb72beeaffa1b6b15 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579263.500918:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000500b57eb/0xb72beeaffa1b6b15 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579263.500951:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000500b57eb/0xb72beeaffa1b6b15 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579263.500957:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000500b57eb/0xb72beeaffa1b6b15 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579263.500962:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000500b57eb already unused, calling callback (00000000e3311356) 00010000:00010000:0.0:1787579263.500965:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000500b57eb/0xb72beeaffa1b6b15 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579263.500971:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000500b57eb/0xb72beeaffa1b6b15 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579263.500984:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000500b57eb/0xb72beeaffa1b6b15 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579263.500994:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579263.501031:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010572ce6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+11:3321:x1874412616814208:12345-0@lo:103: Request processed in 356us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579263.501039:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787579263.501069:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ad8d280a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616814208:0@lo:103: 00010000:00010000:3.0:1787579263.501134:0:6344:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000500b57eb/0xb72beeaffa1b6b15 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579263.501142:0:6344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000500b57eb/0xb72beeaffa1b6b15 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579263.501146:0:6344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000500b57eb/0xb72beeaffa1b6b15 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579264.419198:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579264.486996:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787579264.487021:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ad8d280a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616814336:0@lo:400: 00000100:00100000:0.0:1787579264.487093:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579264.487142:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616814336 00000100:00100000:0.0:1787579264.487148:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616814336 00000100:00100000:0.0:1787579264.487186:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787579264.487194:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a82caa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+11:3321:x1874412616814336:12345-0@lo:400: 00000100:00100000:0.0:1787579264.487232:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a82caa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+11:3321:x1874412616814336:12345-0@lo:400: Request processed in 40us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579264.487238:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787579264.487281:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ad8d280a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616814336:0@lo:400: 00000100:00100000:3.0:1787579264.487463:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787579264.487485:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007b40668a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874412616814464:0@lo:400: 00000100:00100000:3.0:1787579264.487522:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579264.488526:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616814464 00000100:00100000:0.0:1787579264.488533:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616814464 00000100:00100000:0.0:1787579264.488574:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787579264.488581:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d058f027 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874412616814464:12345-0@lo:400: 00000100:00100000:0.0:1787579264.488636:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d058f027 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874412616814464:12345-0@lo:400: Request processed in 56us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579264.488643:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787579264.488674:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007b40668a x1874412616814464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579264.488686:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007b40668a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874412616814464:0@lo:400: 00010000:00010000:0.0:1787579265.440086:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579266.464490:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579267.488008:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579268.512114:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787579268.576100:0:5863:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787579268.576108:0:5863:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0ce90be4800 from 1 10000000:01000000:1.0:1787579268.576112:0:5863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787579268.576155:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: 00000000f6effe6b/0xb72beeaffa1b6b1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579268.576165:0:5863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: 00000000f6effe6b/0xb72beeaffa1b6b1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579268.576187:0:5863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: 00000000f6effe6b/0xb72beeaffa1b6b1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579268.576209:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073e575dc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616814592:0@lo:101: 00000100:00100000:1.0:1787579268.576272:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579268.576334:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set 000000005f44c78f going to sleep for 11 seconds 00000100:00100000:2.0:1787579268.576488:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616814592 00000100:00100000:2.0:1787579268.576497:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616814592 00000100:00100000:2.0:1787579268.576541:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787579268.576550:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9e0e9f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+11:5863:x1874412616814592:12345-0@lo:101: 00010000:00010000:2.0:1787579268.576562:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579268.576574:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b73c5cb0/0xb72beeaffa1b6b23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6b1c expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579268.576595:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b73c5cb0/0xb72beeaffa1b6b23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6b1c expref: 12 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579268.576604:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b73c5cb0/0xb72beeaffa1b6b23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6b1c expref: 12 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579268.576629:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b73c5cb0, rc 0) 00000100:00100000:2.0:1787579268.576676:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9e0e9f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:5863:x1874412616814592:12345-0@lo:101: Request processed in 127us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579268.576681:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787579268.576760:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073e575dc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616814592:0@lo:101: 00010000:00010000:1.0:1787579268.576788:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: 00000000f6effe6b/0xb72beeaffa1b6b1c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6b23 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579268.576796:0:5863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: 00000000f6effe6b/0xb72beeaffa1b6b1c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6b23 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579268.576848:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073e575dc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616814720:0@lo:501: 00000100:00100000:1.0:1787579268.576871:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579268.576893:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set 000000005f44c78f going to sleep for 11 seconds 00000100:00100000:0.0:1787579268.576954:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616814720 00000100:00100000:0.0:1787579268.576959:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616814720 00000100:00100000:0.0:1787579268.576989:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787579268.576995:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037877972 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:5863:x1874412616814720:12345-0@lo:501: 00000100:00100000:0.0:1787579268.577284:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037877972 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:5863:x1874412616814720:12345-0@lo:501: Request processed in 290us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579268.577298:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787579268.577578:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073e575dc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616814720:0@lo:501: 00000100:00100000:3.0:1787579268.577609:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b5e38579 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616814848:0@lo:503: 00000100:00100000:3.0:1787579268.577686:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579268.577711:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d16d52eb going to sleep for 11 seconds 00000100:00100000:3.0:1787579268.577723:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616814848 00000100:00100000:3.0:1787579268.577726:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616814848 00000100:00100000:3.0:1787579268.577745:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787579268.577751:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa1cf5b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:5863:x1874412616814848:12345-0@lo:503: 00000100:00100000:3.0:1787579268.578005:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa1cf5b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:5863:x1874412616814848:12345-0@lo:503: Request processed in 254us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579268.578012:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787579268.578047:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b5e38579 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616814848:0@lo:503: 00000100:00100000:3.0:1787579268.578244:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b5e38579 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6685:1874412616814976:0@lo:502: 00000100:00100000:3.0:1787579268.578282:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579268.578301:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616814976 00000100:00100000:3.0:1787579268.578305:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616814976 00000100:00100000:3.0:1787579268.578321:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787579268.578326:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067aeab8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:6685:x1874412616814976:12345-0@lo:502: 00000100:00100000:3.0:1787579268.578442:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067aeab8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:6685:x1874412616814976:12345-0@lo:502: Request processed in 116us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579268.578448:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787579268.578474:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set 000000001bf43b36 going to sleep for 11 seconds 00000100:00100000:3.0:1787579268.578484:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b5e38579 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6685:1874412616814976:0@lo:502: 00000020:01000000:3.0:1787579268.578500:0:6685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787579268.578508:0:6685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579268.578510:0:6685:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787579268.578517:0:6685:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0ce90be4800 00000020:00000080:3.0:1787579268.578519:0:6685:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787579268.578553:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f16300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6685:1874412616815104:0@lo:502: 00000100:00100000:3.0:1787579268.578585:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579268.578603:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616815104 00000100:00100000:3.0:1787579268.578606:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616815104 00000100:00100000:3.0:1787579268.578622:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787579268.578627:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:6685:x1874412616815104:12345-0@lo:502: 00000100:00100000:3.0:1787579268.578724:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:6685:x1874412616815104:12345-0@lo:502: Request processed in 95us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579268.578730:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787579268.578754:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9816b240 going to sleep for 11 seconds 00000100:00100000:3.0:1787579268.578765:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f16300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6685:1874412616815104:0@lo:502: 00000020:01000000:3.0:1787579268.578791:0:6685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787579268.578800:0:6685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579268.578802:0:6685:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787579268.578805:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787579268.578854:0:5863:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787579268.578976:0:5863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787579268.578984:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148ba00/0xb72beeaffa1b6b1c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6b23 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579268.578993:0:5863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce8148ba00/0xb72beeaffa1b6b1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6b23 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787579269.351649:0:6707:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787579269.351653:0:6707:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787579269.351873:0:6707:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa0ce84eda800 00000020:01000004:2.0:1787579269.351984:0:6707:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787579269.351996:0:6707:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787579269.352008:0:6707:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffffa0ceb591cd28) 00000020:00000080:2.0:1787579269.352033:0:6707:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787579269.390220:0:6707:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787579269.390447:0:6707:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787579269.444108:0:6707:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1787579269.477828:0:6707:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787579269.477864:0:6707:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1787579269.478212:0:6707:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787579269.478242:0:6707:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1787579269.479869:0:6707:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787579269.479880:0:6707:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787579269.479900:0:6707:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb72beeaffa1b6b31 00000020:01000004:1.0:1787579269.479908:0:6707:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1787579269.479942:0:6707:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.153@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787579269.479946:0:6707:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787579269.479951:0:6707:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787579269.479956:0:6707:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787579269.479967:0:6707:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffffa0ce86748000) 00000020:00000080:1.0:1787579269.479976:0:6707:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1787579269.489289:0:6707:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787579269.489472:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787579269.489477:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787579269.491350:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787579269.491360:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787579269.491882:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787579269.491901:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787579269.511867:0:6707:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787579269.518367:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787579269.518377:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787579269.519473:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787579269.519481:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:0.0:1787579269.537489:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579269.600359:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616815232:0@lo:400: 00000100:00100000:0.0:1787579269.600437:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579269.600504:0:6707:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787579269.600509:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616815360:0@lo:400: 00000100:00100000:0.0:1787579269.600535:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579269.600575:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616815232 00000100:00100000:0.0:1787579269.600582:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616815232 00000100:00100000:0.0:1787579269.600621:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787579269.600629:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:3320:x1874412616815232:12345-0@lo:400: 00000100:00100000:1.0:1787579269.600688:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616815360 00000100:00100000:1.0:1787579269.600693:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616815360 00000100:00100000:1.0:1787579269.600720:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787579269.600728:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616815360:12345-0@lo:400: 00000100:00100000:1.0:1787579269.600923:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616815360:12345-0@lo:400: Request processed in 41us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579269.600951:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787579269.601002:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0cec119f480 x1874412616815360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579269.601016:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616815360:0@lo:400: 00000100:00100000:0.0:1787579269.601731:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:3320:x1874412616815232:12345-0@lo:400: Request processed in 1091us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579269.601740:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787579269.601805:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616815232:0@lo:400: 00000100:00100000:3.0:1787579269.602779:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787579269.602787:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787579269.606321:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787579269.606335:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787579269.610101:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787579269.610115:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787579269.615106:0:6707:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787579269.615300:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787579269.615307:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787579269.626857:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787579269.626872:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787579269.671707:0:6707:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787579269.672315:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787579269.672322:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787579269.673800:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787579269.673811:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787579269.674298:0:6707:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787579269.674482:0:6707:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787579269.674489:0:6707:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.153@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787579269.690644:0:6707:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.153@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787579269.690761:0:6707:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.153@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1787579269.690766:0:6707:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787579269.690779:0:6707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787579269.690780:0:6707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787579269.690781:0:6707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787579269.690783:0:6707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787579269.690784:0:6707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787579269.690785:0:6707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787579269.690787:0:6707:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787579269.690788:0:6707:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787579269.690790:0:6707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787579269.690791:0:6707:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787579269.690795:0:6707:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1787579269.690803:0:6707:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787579269.690804:0:6707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787579269.690805:0:6707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787579269.690806:0:6707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787579269.690807:0:6707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787579269.690808:0:6707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787579269.690809:0:6707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787579269.690810:0:6707:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787579269.690810:0:6707:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787579269.690811:0:6707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787579269.690812:0:6707:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787579269.690843:0:6707:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787579269.690861:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616815488:0@lo:253: 00000100:00100000:0.0:1787579269.690959:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579269.691073:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616815488 00000100:00100000:1.0:1787579269.691082:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616815488 00000100:00100000:0.0:1787579269.691085:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce87c05d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787579269.691212:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787579269.691223:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:6707:x1874412616815488:12345-0@lo:253: 20000000:01000000:1.0:1787579269.691259:0:5861:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787579269.691264:0:5861:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787579269.691269:0:5861:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787579269.691272:0:5861:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787579269.692150:0:5861:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787579269.692366:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787579269.692382:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787579269.692423:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1787579269.692432:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787579269.692464:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1787579269.692524:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1787579269.692893:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1787579269.692912:0:5861:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.153@tcp 20000000:01000000:1.0:1787579269.692914:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.153@tcp (null) (null) (null) 00000040:00080000:1.0:1787579269.692999:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1787579269.693115:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787579269.693181:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1787579269.693193:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.153@tcp (null) (null) 00000040:00080000:2.0:1787579269.693227:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1787579269.693244:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787579269.693279:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1787579269.693331:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1787579269.694112:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1787579269.694132:0:5861:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.153@tcp 20000000:01000000:2.0:1787579269.694134:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.153@tcp (null) (null) (null) 00000040:00080000:2.0:1787579269.694170:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1787579269.694178:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787579269.694206:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1787579269.694214:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.153@tcp (null) (null) 00000040:00080000:2.0:1787579269.694255:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1787579269.694263:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787579269.694293:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1787579269.694330:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1787579269.694347:0:5861:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787579269.694350:0:5861:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787579269.694353:0:5861:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787579269.694363:0:5861:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787579269.694366:0:5861:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787579269.694401:0:5861:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787579269.694404:0:5861:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787579269.694918:0:6722:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1787579269.695048:0:6722:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1787579269.695096:0:6722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1787579269.695353:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1787579269.695390:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1787579269.695445:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1787579269.695459:0:5861:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787579269.695461:0:5861:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787579269.695795:0:6723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1787579269.696147:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1787579269.696185:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1787579269.696250:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1787579269.696263:0:5861:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787579269.696265:0:5861:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787579269.696726:0:6724:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1787579269.696792:0:6724:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1787579269.696843:0:6724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1787579269.697085:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1787579269.697127:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1787579269.697176:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1787579269.697191:0:5861:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1787579269.697193:0:5861:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1787579269.697202:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787579269.697220:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6b3f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579269.697236:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ce8148a400/0xb72beeaffa1b6a58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6a51 expref: 12 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579269.697242:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ce80031800/0xb72beeaffa1b6a74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6a6d expref: 12 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579269.697249:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ce80031a00/0xb72beeaffa1b6ae4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6add expref: 12 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579269.697255:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6b3f lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579269.697290:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ce80031a00/0xb72beeaffa1b6ae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b6add expref: 12 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579269.697305:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0ce80031a00/0xb72beeaffa1b6ae4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b6add expref: 12 pid: 5860 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579269.697318:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5861:1874412616815616:0@lo:104: 00000100:00100000:2.0:1787579269.697376:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787579269.697423:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ce80031800/0xb72beeaffa1b6a74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b6a6d expref: 12 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579269.697431:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0ce80031800/0xb72beeaffa1b6a74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b6a6d expref: 12 pid: 5859 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579269.697459:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5861:1874412616815744:0@lo:104: 00000100:00100000:2.0:1787579269.697486:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579269.697509:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616815616 00010000:00010000:2.0:1787579269.697519:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ce8148a400/0xb72beeaffa1b6a58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b6a51 expref: 12 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579269.697528:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0ce8148a400/0xb72beeaffa1b6a58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b6a51 expref: 12 pid: 5859 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579269.697531:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616815744 00000100:00100000:2.0:1787579269.697537:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5861:1874412616815872:0@lo:104: 00000100:00100000:1.0:1787579269.697537:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616815744 00000100:00100000:2.0:1787579269.697556:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579269.697565:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce91280f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787579269.697565:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616815872 00000100:00100000:1.0:1787579269.697567:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616815872 00000100:00100000:1.0:1787579269.697580:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787579269.697588:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+4:5861:x1874412616815744:12345-0@lo:104: 00010000:00010000:1.0:1787579269.697600:0:5848:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ce8148ac00/0xb72beeaffa1b6a6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6a74 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579269.697658:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787579269.697665:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+4:5861:x1874412616815744:12345-0@lo:104: Request processed in 77us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579269.697673:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787579269.697681:0:5853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787579269.697689:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce8148ac00/0xb72beeaffa1b6a6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6a74 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579269.697694:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787579269.697703:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148ac00 already unused, calling callback (ffffffffc1c71c20) 00000100:00100000:1.0:1787579269.697708:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+3:5861:x1874412616815872:12345-0@lo:104: 10000000:00010000:3.0:1787579269.697710:0:5853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8148ac00/0xb72beeaffa1b6a6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b6a74 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579269.697721:0:5848:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc800/0xb72beeaffa1b6a51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6a58 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579269.697722:0:5853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce8148ac00/0xb72beeaffa1b6a6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b6a74 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787579269.697751:0:5853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8148ac00/0xb72beeaffa1b6a6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b6a74 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579269.697756:0:5853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787579269.697800:0:5853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ce8148ac00/0xb72beeaffa1b6a6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6a74 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579269.697800:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5861:1874412616815744:0@lo:104: 00010000:00010000:3.0:1787579269.697811:0:5853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787579269.697835:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce8148ac00/0xb72beeaffa1b6a6d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6a74 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579269.697839:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787579269.697840:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5861:1874412616815872:0@lo:104: 00010000:00010000:3.0:1787579269.697847:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce8148ac00/0xb72beeaffa1b6a6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6a74 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579269.697853:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+3:5861:x1874412616815872:12345-0@lo:104: Request processed in 145us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579269.697863:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787579269.697870:0:5853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787579269.697875:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc800/0xb72beeaffa1b6a51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6a58 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579269.697880:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579269.697882:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce813fc800 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:3.0:1787579269.697886:0:5853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc800/0xb72beeaffa1b6a51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b6a58 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579269.697893:0:5853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc800/0xb72beeaffa1b6a51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b6a58 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787579269.697899:0:5853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc800/0xb72beeaffa1b6a51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b6a58 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579269.697905:0:5853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787579269.697923:0:5853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc800/0xb72beeaffa1b6a51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6a58 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579269.697946:0:5853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787579269.697971:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc800/0xb72beeaffa1b6a51 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6a58 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579269.697978:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc800/0xb72beeaffa1b6a51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6a58 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579269.697983:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1787579269.697990:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579269.697994:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579269.697996:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579269.697997:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616816128:0@lo:103: 00000100:00100000:3.0:1787579269.698017:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616816000:0@lo:103: 00000100:00100000:1.0:1787579269.698030:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579269.698057:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579269.698079:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616816128 00000100:00100000:1.0:1787579269.698084:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616816128 00010000:00010000:1.0:1787579269.698104:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ce8148a400/0xb72beeaffa1b6a58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6a51 expref: 13 pid: 5859 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579269.698106:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616816000 00000100:00100000:3.0:1787579269.698111:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616816000 00010000:00010000:3.0:1787579269.698128:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ce80031800/0xb72beeaffa1b6a74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6a6d expref: 14 pid: 5859 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579269.698140:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787579269.698149:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:3320:x1874412616816128:12345-0@lo:103: 00010000:00010000:1.0:1787579269.698158:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787579269.698163:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ce8148a400/0xb72beeaffa1b6a58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6a51 expref: 14 pid: 5859 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579269.698172:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ce8148a400/0xb72beeaffa1b6a58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b6a51 expref: 14 pid: 5859 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579269.698187:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce8148a400/0xb72beeaffa1b6a58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b6a51 expref: 14 pid: 5859 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579269.698199:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787579269.698229:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:3320:x1874412616816128:12345-0@lo:103: Request processed in 81us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579269.698238:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616815616 00000100:00100000:2.0:1787579269.698261:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616816128:0@lo:103: 00000100:00100000:0.0:1787579269.698277:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787579269.698287:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+3:5861:x1874412616815616:12345-0@lo:104: 00010000:00010000:0.0:1787579269.698295:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f000/0xb72beeaffa1b6add lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6ae4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579269.698343:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787579269.698349:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+3:5861:x1874412616815616:12345-0@lo:104: Request processed in 65us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579269.698357:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787579269.698370:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5861:1874412616815616:0@lo:104: 00010000:00010000:2.0:1787579269.698391:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6b3f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579269.698405:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787579269.698414:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787579269.698424:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:3322:x1874412616816000:12345-0@lo:103: 00010000:00010000:1.0:1787579269.698431:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787579269.698433:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787579269.698437:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f000/0xb72beeaffa1b6add lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6ae4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579269.698441:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ce80031800/0xb72beeaffa1b6a74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6a6d expref: 12 pid: 5859 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579269.698455:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8152f000 already unused, calling callback (ffffffffc1c71c20) 00010000:00010000:3.0:1787579269.698459:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ce80031800/0xb72beeaffa1b6a74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b6a6d expref: 12 pid: 5859 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787579269.698462:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f000/0xb72beeaffa1b6add lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b6ae4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579269.698478:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f000/0xb72beeaffa1b6add lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b6ae4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579269.698480:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce80031800/0xb72beeaffa1b6a74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b6a6d expref: 12 pid: 5859 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787579269.698486:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f000/0xb72beeaffa1b6add lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b6ae4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579269.698499:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:1.0:1787579269.698501:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787579269.698538:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f000/0xb72beeaffa1b6add lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6ae4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579269.698545:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787579269.698591:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616816256:0@lo:103: 00010000:00010000:1.0:1787579269.698631:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f000/0xb72beeaffa1b6add lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6ae4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579269.698638:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f000/0xb72beeaffa1b6add lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6ae4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579269.698653:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579269.698655:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579269.698657:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579269.698707:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579269.698724:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+11:3322:x1874412616816000:12345-0@lo:103: Request processed in 299us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579269.698731:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787579269.698745:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616816256 00000100:00100000:3.0:1787579269.698748:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616816256 00010000:00010000:3.0:1787579269.698759:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ce80031a00/0xb72beeaffa1b6ae4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6add expref: 11 pid: 5860 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579269.698795:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787579269.698802:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+11:3320:x1874412616816256:12345-0@lo:103: 00000100:00100000:1.0:1787579269.698808:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616816000:0@lo:103: 00010000:00010000:3.0:1787579269.698809:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579269.698816:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ce80031a00/0xb72beeaffa1b6ae4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6add expref: 11 pid: 5860 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579269.698827:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ce80031a00/0xb72beeaffa1b6ae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b6add expref: 11 pid: 5860 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579269.698837:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce80031a00/0xb72beeaffa1b6ae4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b6add expref: 11 pid: 5860 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579269.698847:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6b3f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579269.698854:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6b3f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579269.698866:0:5851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6b3f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579269.698883:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6b3f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579269.698890:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6b3f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579269.698895:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6b3f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579269.698901:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce813fda00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:3.0:1787579269.698905:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6b3f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579269.698911:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6b3f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579269.698946:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6b3f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579269.698956:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579269.698985:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+10:3320:x1874412616816256:12345-0@lo:103: Request processed in 183us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579269.698991:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787579269.699015:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616816256:0@lo:103: 00010000:00010000:2.0:1787579269.699296:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6b3f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579269.699307:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6b3f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579269.699313:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6b3f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787579269.699337:0:5861:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787579269.736676:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+9:6707:x1874412616815488:12345-0@lo:253: Request processed in 45446us (45742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579269.736690:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787579269.736695:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616815488:0@lo:253: 10000000:01000000:0.0:1787579269.736709:0:6707:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787579269.736713:0:6707:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787579269.736714:0:6707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787579269.736715:0:6707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787579269.736716:0:6707:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1787579269.736718:0:6707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787579269.736719:0:6707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787579269.736720:0:6707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787579269.736722:0:6707:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787579269.736723:0:6707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787579269.736725:0:6707:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787579269.736744:0:6707:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0ce84eda800 from lustre-OST0000 10000000:01000000:0.0:1787579269.736781:0:6707:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787579269.736784:0:6707:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787579269.736791:0:6707:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa0ce98720000 local copy 10000000:01000000:0.0:1787579269.736795:0:6707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787579269.736837:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce80030c00/0xb72beeaffa1b6b46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579269.736848:0:6707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.153@tcp lock: ffffa0ce80030c00/0xb72beeaffa1b6b46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579269.736857:0:6707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce80030c00/0xb72beeaffa1b6b46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579269.736874:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616816384:0@lo:101: 00000100:00100000:0.0:1787579269.736917:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579269.737002:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce87c05540 going to sleep for 11 seconds 00000100:00100000:2.0:1787579269.737331:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616816384 00000100:00100000:2.0:1787579269.737338:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616816384 00000100:00100000:2.0:1787579269.737379:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787579269.737388:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+9:6707:x1874412616816384:12345-0@lo:101: 00010000:00010000:2.0:1787579269.737399:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579269.737412:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6b4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6b46 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579269.737432:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6b4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6b46 expref: 10 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579269.737442:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6b4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6b46 expref: 10 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579269.737451:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce813fda00, rc 0) 00000100:00100000:2.0:1787579269.737494:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+10:6707:x1874412616816384:12345-0@lo:101: Request processed in 107us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579269.737500:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787579269.737593:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616816384:0@lo:101: 00010000:00010000:1.0:1787579269.737607:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce80030c00/0xb72beeaffa1b6b46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb72beeaffa1b6b4d expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579269.737616:0:6707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce80030c00/0xb72beeaffa1b6b46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb72beeaffa1b6b4d expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579269.737706:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616816512:0@lo:501: 00000100:00100000:1.0:1787579269.737735:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579269.737789:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d3759c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787579269.737805:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616816512 00000100:00100000:2.0:1787579269.737809:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616816512 00000100:00100000:2.0:1787579269.738059:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787579269.738067:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+10:6707:x1874412616816512:12345-0@lo:501: 00000100:00100000:2.0:1787579269.738277:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+10:6707:x1874412616816512:12345-0@lo:501: Request processed in 210us (541us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787579269.738293:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787579269.738307:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616816512:0@lo:501: 10000000:01000000:1.0:1787579269.738321:0:6707:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787579269.738346:0:6707:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787579269.738352:0:6707:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce80030c00/0xb72beeaffa1b6b46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb72beeaffa1b6b4d expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579269.738359:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce80030c00/0xb72beeaffa1b6b46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb72beeaffa1b6b4d expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579269.738366:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.153@tcp lock: ffffa0ce80030c00/0xb72beeaffa1b6b46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb72beeaffa1b6b4d expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579269.738427:0:6707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787579269.738439:0:5853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787579269.738445:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce80030c00/0xb72beeaffa1b6b46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xb72beeaffa1b6b4d expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579269.738449:0:6707:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0ce84eda800 00010000:00010000:3.0:1787579269.738453:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce80030c00 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:3.0:1787579269.738457:0:5853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce80030c00/0xb72beeaffa1b6b46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xb72beeaffa1b6b4d expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579269.738476:0:5853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce80030c00/0xb72beeaffa1b6b46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xb72beeaffa1b6b4d expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787579269.738483:0:5853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce80030c00/0xb72beeaffa1b6b46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xb72beeaffa1b6b4d expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579269.738488:0:5853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787579269.738507:0:5853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ce80030c00/0xb72beeaffa1b6b46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb72beeaffa1b6b4d expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579269.738587:0:6707:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787579269.738593:0:6707:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffffa0ce98720000 10000000:01000000:1.0:1787579269.738596:0:6707:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787579269.738599:0:6707:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffffa0ce98720000 from 1 10000000:01000000:1.0:1787579269.738602:0:6707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787579269.738620:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a400/0xb72beeaffa1b6b54 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579269.738627:0:6707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a400/0xb72beeaffa1b6b54 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579269.738636:0:5853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787579269.738636:0:6707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a400/0xb72beeaffa1b6b54 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579269.738647:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616816768:0@lo:101: 00000100:00100000:1.0:1787579269.738682:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579269.738689:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787579269.738703:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d375b40 going to sleep for 11 seconds 00010000:00010000:3.0:1787579269.738714:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce80030c00/0xb72beeaffa1b6b46 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb72beeaffa1b6b4d expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579269.738721:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce80030c00/0xb72beeaffa1b6b46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb72beeaffa1b6b4d expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579269.738738:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579269.738741:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579269.738742:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579269.738759:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616816768 00000100:00100000:0.0:1787579269.738764:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616816768 00000100:00100000:2.0:1787579269.738784:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616816640:0@lo:103: 00000100:00100000:0.0:1787579269.738806:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787579269.738811:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579269.738819:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+10:6707:x1874412616816768:12345-0@lo:101: 00010000:00010000:0.0:1787579269.738828:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579269.738838:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce80031a00/0xb72beeaffa1b6b5b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6b54 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579269.738900:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce80031a00/0xb72beeaffa1b6b5b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6b54 expref: 11 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579269.738910:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce80031a00/0xb72beeaffa1b6b5b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6b54 expref: 11 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579269.738917:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce80031a00, rc 0) 00000100:00100000:3.0:1787579269.739129:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616816640 00000100:00100000:3.0:1787579269.739134:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616816640 00000100:00100000:3.0:1787579269.739164:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787579269.739164:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:6707:x1874412616816768:12345-0@lo:101: Request processed in 345us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579269.739170:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:3322:x1874412616816640:12345-0@lo:103: 00000100:00100000:0.0:1787579269.739171:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:3.0:1787579269.739189:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579269.739200:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6b4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb72beeaffa1b6b46 expref: 11 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579269.739212:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787579269.739242:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616816768:0@lo:101: 00010000:00010000:1.0:1787579269.739253:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a400/0xb72beeaffa1b6b54 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6b5b expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579269.739255:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+10:3322:x1874412616816640:12345-0@lo:103: Request processed in 86us (444us total) trans 0 rc 0/0 00010000:00010000:1.0:1787579269.739261:0:6707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a400/0xb72beeaffa1b6b54 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6b5b expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579269.739262:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 10000000:01000000:1.0:1787579269.739274:0:6707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787579269.739286:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a400/0xb72beeaffa1b6b54 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6b5b expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579269.739294:0:6707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a400/0xb72beeaffa1b6b54 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6b5b expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579269.739300:0:6707:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787579269.739304:0:6707:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787579269.739308:0:6707:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787579269.739310:0:6707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787579269.739325:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6b62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579269.739331:0:6707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6b62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579269.739338:0:6707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6b62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579269.739349:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616816896:0@lo:101: 00000100:00100000:1.0:1787579269.739381:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579269.739457:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616816640:0@lo:103: 00000100:00100000:1.0:1787579269.739508:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d375b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787579269.739544:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616816896 00000100:00100000:3.0:1787579269.739548:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616816896 00000100:00100000:3.0:1787579269.739610:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787579269.739618:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+10:6707:x1874412616816896:12345-0@lo:101: 00010000:00010000:3.0:1787579269.739625:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579269.739634:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce8152e600/0xb72beeaffa1b6b69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6b62 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579269.739652:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce8152e600/0xb72beeaffa1b6b69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6b62 expref: 11 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579269.739661:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce8152e600/0xb72beeaffa1b6b69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6b62 expref: 11 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579269.739668:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8152e600, rc 0) 00000100:00100000:3.0:1787579269.739697:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+11:6707:x1874412616816896:12345-0@lo:101: Request processed in 80us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579269.739703:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787579269.739715:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616816896:0@lo:101: 00010000:00010000:1.0:1787579269.739726:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6b62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6b69 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579269.739733:0:6707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6b62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6b69 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579269.739817:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616817024:0@lo:501: 00000100:00100000:1.0:1787579269.740023:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579269.740047:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d375b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787579269.740060:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616817024 00000100:00100000:0.0:1787579269.740064:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616817024 00000100:00100000:0.0:1787579269.740087:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787579269.740093:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+11:6707:x1874412616817024:12345-0@lo:501: 00000100:00100000:0.0:1787579269.740291:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+11:6707:x1874412616817024:12345-0@lo:501: Request processed in 197us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579269.740298:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787579269.740375:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616817024:0@lo:501: 00000100:00100000:1.0:1787579269.740401:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616817152:0@lo:503: 00000100:00100000:1.0:1787579269.740438:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579269.740490:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d375b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787579269.740525:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616817152 00000100:00100000:3.0:1787579269.740529:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616817152 00000100:00100000:3.0:1787579269.740588:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787579269.740596:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+11:6707:x1874412616817152:12345-0@lo:503: 00000100:00100000:3.0:1787579269.740729:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+11:6707:x1874412616817152:12345-0@lo:503: Request processed in 134us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579269.740736:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787579269.740811:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616817152:0@lo:503: 00000040:00080000:0.0:1787579269.741096:0:6707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787579269.741144:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616817280:0@lo:502: 00000100:00100000:0.0:1787579269.741177:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579269.742402:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce87c05000 going to sleep for 11 seconds 00000100:00100000:1.0:1787579269.742540:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616817280 00000100:00100000:1.0:1787579269.742619:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616817280 00000100:00100000:1.0:1787579269.742699:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787579269.742708:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+11:6707:x1874412616817280:12345-0@lo:502: 00000100:00100000:1.0:1787579269.743054:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+11:6707:x1874412616817280:12345-0@lo:502: Request processed in 346us (1876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579269.743063:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787579269.743156:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616817280:0@lo:502: 00000040:00080000:0.0:1787579269.744650:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787579269.744726:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787579269.744760:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787579269.744845:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787579269.744883:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787579269.744916:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787579269.748377:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616817408:0@lo:502: 00000100:00100000:0.0:1787579269.749234:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579269.749295:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce87c05000 going to sleep for 11 seconds 00000100:00100000:2.0:1787579269.749635:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616817408 00000100:00100000:2.0:1787579269.749643:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616817408 00000100:00100000:2.0:1787579269.749691:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787579269.749701:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+11:6707:x1874412616817408:12345-0@lo:502: 00000100:00100000:2.0:1787579269.749917:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+11:6707:x1874412616817408:12345-0@lo:502: Request processed in 217us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579269.749949:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787579269.750087:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616817408:0@lo:502: 00000040:00080000:0.0:1787579269.750367:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787579269.750382:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1787579269.752586:0:6726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787579269.752597:0:6726:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787579269.752603:0:6726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579269.752606:0:6726:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787579269.752611:0:6726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787579269.752625:0:6726:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffffa0ceb485cd28) 00000020:00000080:0.0:1787579269.752644:0:6726:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787579269.752649:0:6726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787579269.752722:0:6726:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0ce84eda800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787579269.752730:0:6726:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787579269.752744:0:6726:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb72beeaffa1b6b77 00010000:00010000:0.0:1787579269.759636:0:6726:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1787579269.760169:0:6726:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1787579269.762396:0:6726:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787579269.762645:0:6726:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1787579269.771632:0:6726:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787579269.772455:0:6726:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787579269.773794:0:6726:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787579269.773804:0:6726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787579269.773810:0:6726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579269.773812:0:6726:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787579269.773815:0:6726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787579269.773818:0:6726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579269.773819:0:6726:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787579269.773823:0:6726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787579269.773824:0:6726:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787579269.773867:0:6726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787579269.773871:0:6726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579269.773872:0:6726:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787579269.773876:0:6726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787579269.774113:0:6707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1787579269.774135:0:6707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787579269.774154:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6b62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6b69 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579269.774165:0:6707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6b62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6b69 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579269.774173:0:6707:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0ce84eda800 from 1 10000000:01000000:2.0:1787579269.774175:0:6707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787579269.774204:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce813fca00/0xb72beeaffa1b6b7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579269.774211:0:6707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ce813fca00/0xb72beeaffa1b6b7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579269.774222:0:6707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce813fca00/0xb72beeaffa1b6b7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579269.774241:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616817536:0@lo:101: 00000100:00100000:2.0:1787579269.774303:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579269.774345:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce91280d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787579269.774428:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616817536 00000100:00100000:0.0:1787579269.774434:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616817536 00000100:00100000:0.0:1787579269.774471:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787579269.774479:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+11:6707:x1874412616817536:12345-0@lo:101: 00010000:00010000:0.0:1787579269.774490:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579269.774500:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce80031800/0xb72beeaffa1b6b85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6b7e expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579269.774519:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce80031800/0xb72beeaffa1b6b85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6b7e expref: 12 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579269.774529:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce80031800/0xb72beeaffa1b6b85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6b7e expref: 12 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579269.774597:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce80031800, rc 0) 00000100:00100000:0.0:1787579269.774639:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:6707:x1874412616817536:12345-0@lo:101: Request processed in 160us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579269.774653:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787579269.774720:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616817536:0@lo:101: 00010000:00010000:3.0:1787579269.774739:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce813fca00/0xb72beeaffa1b6b7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6b85 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579269.774747:0:6707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce813fca00/0xb72beeaffa1b6b7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6b85 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579269.774834:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f14e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616817664:0@lo:501: 00000100:00100000:3.0:1787579269.774858:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579269.774878:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce905c2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787579269.775004:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616817664 00000100:00100000:2.0:1787579269.775008:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616817664 00000100:00100000:2.0:1787579269.775035:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787579269.775041:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:6707:x1874412616817664:12345-0@lo:501: 00000100:00100000:2.0:1787579269.775203:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:6707:x1874412616817664:12345-0@lo:501: Request processed in 161us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579269.775210:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787579269.775282:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f14e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616817664:0@lo:501: 00000100:00100000:3.0:1787579269.775304:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f14e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616817792:0@lo:503: 00000100:00100000:3.0:1787579269.775336:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579269.775358:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce905c2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787579269.775400:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616817792 00000100:00100000:2.0:1787579269.775403:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616817792 00000100:00100000:2.0:1787579269.775486:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787579269.775493:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:6707:x1874412616817792:12345-0@lo:503: 00000100:00100000:2.0:1787579269.775646:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:6707:x1874412616817792:12345-0@lo:503: Request processed in 153us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579269.775652:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787579269.778786:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f14e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616817792:0@lo:503: 00000040:00080000:3.0:1787579269.779091:0:6707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787579269.779184:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f14e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616817920:0@lo:502: 00000100:00100000:3.0:1787579269.779253:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579269.779279:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce87d20300 going to sleep for 11 seconds 00000100:00100000:3.0:1787579269.779302:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616817920 00000100:00100000:3.0:1787579269.779307:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616817920 00000100:00100000:3.0:1787579269.779338:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787579269.779346:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:6707:x1874412616817920:12345-0@lo:502: 00000100:00100000:3.0:1787579269.779510:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:6707:x1874412616817920:12345-0@lo:502: Request processed in 163us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579269.779518:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787579269.780042:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f14e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616817920:0@lo:502: 00000040:00080000:3.0:1787579269.780312:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787579269.780363:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787579269.780393:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f14e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616818048:0@lo:502: 00000100:00100000:3.0:1787579269.780441:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579269.780463:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce87d20300 going to sleep for 11 seconds 00000100:00100000:3.0:1787579269.780482:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616818048 00000100:00100000:3.0:1787579269.780487:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616818048 00000100:00100000:3.0:1787579269.780513:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787579269.780519:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:6707:x1874412616818048:12345-0@lo:502: 00000100:00100000:3.0:1787579269.780731:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:6707:x1874412616818048:12345-0@lo:502: Request processed in 210us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579269.780740:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787579269.780797:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f14e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616818048:0@lo:502: 00000040:00080000:3.0:1787579269.780870:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787579269.780880:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787579269.783404:0:6730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787579269.783415:0:6730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579269.783417:0:6730:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787579269.783424:0:6730:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0ce84eda800 00000020:00000080:0.0:1787579269.783427:0:6730:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787579269.783447:0:6730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787579269.783450:0:6730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579269.783451:0:6730:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787579269.783454:0:6730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787579269.783615:0:6707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787579269.783638:0:6707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787579269.783655:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce813fca00/0xb72beeaffa1b6b7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6b85 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579269.783666:0:6707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce813fca00/0xb72beeaffa1b6b7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6b85 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579269.783700:0:6707:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787579269.783703:0:6707:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0ce84eda800 10000000:01000000:2.0:1787579269.783705:0:6707:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0ce84eda800 10000000:01000000:2.0:1787579269.783709:0:6707:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787579269.783723:0:6707:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0ce84eda800 from 1 10000000:01000000:2.0:1787579269.783725:0:6707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787579269.783759:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce813fda00/0xb72beeaffa1b6b8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579269.783779:0:6707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ce813fda00/0xb72beeaffa1b6b8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579269.783790:0:6707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce813fda00/0xb72beeaffa1b6b8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579269.783811:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616818176:0@lo:101: 00000100:00100000:2.0:1787579269.783872:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579269.783917:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce983a3300 going to sleep for 11 seconds 00000100:00100000:1.0:1787579269.784158:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616818176 00000100:00100000:1.0:1787579269.784165:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616818176 00000100:00100000:1.0:1787579269.784206:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787579269.784214:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:6707:x1874412616818176:12345-0@lo:101: 00010000:00010000:1.0:1787579269.784235:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579269.784246:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce8148b800/0xb72beeaffa1b6b93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6b8c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579269.784267:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce8148b800/0xb72beeaffa1b6b93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6b8c expref: 13 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579269.784276:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce8148b800/0xb72beeaffa1b6b93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6b8c expref: 13 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579269.784283:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8148b800, rc 0) 00000100:00100000:1.0:1787579269.784397:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:6707:x1874412616818176:12345-0@lo:101: Request processed in 182us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579269.784404:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787579269.784514:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616818176:0@lo:101: 00010000:00010000:2.0:1787579269.784527:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce813fda00/0xb72beeaffa1b6b8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6b93 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579269.784536:0:6707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce813fda00/0xb72beeaffa1b6b8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6b93 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579269.784689:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616818304:0@lo:501: 00000100:00100000:2.0:1787579269.784717:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579269.784786:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce983a3300 going to sleep for 11 seconds 00000100:00100000:0.0:1787579269.784825:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616818304 00000100:00100000:0.0:1787579269.784830:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616818304 00000100:00100000:0.0:1787579269.784897:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787579269.784905:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:6707:x1874412616818304:12345-0@lo:501: 00000100:00100000:0.0:1787579269.785272:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:6707:x1874412616818304:12345-0@lo:501: Request processed in 367us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579269.785279:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787579269.785347:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616818304:0@lo:501: 00000100:00100000:2.0:1787579269.785377:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616818432:0@lo:503: 00000100:00100000:2.0:1787579269.785413:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579269.785535:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce983a3300 going to sleep for 11 seconds 00000100:00100000:3.0:1787579269.785707:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616818432 00000100:00100000:3.0:1787579269.785713:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616818432 00000100:00100000:3.0:1787579269.785737:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787579269.785743:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:6707:x1874412616818432:12345-0@lo:503: 00000100:00100000:3.0:1787579269.785902:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:6707:x1874412616818432:12345-0@lo:503: Request processed in 158us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579269.785910:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787579269.786068:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616818432:0@lo:503: 00000040:00080000:2.0:1787579269.786306:0:6707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787579269.786375:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616818560:0@lo:502: 00000100:00100000:2.0:1787579269.786411:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579269.786439:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce983a3300 going to sleep for 11 seconds 00000100:00100000:3.0:1787579269.786495:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616818560 00000100:00100000:3.0:1787579269.786499:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616818560 00000100:00100000:3.0:1787579269.786519:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787579269.786525:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:6707:x1874412616818560:12345-0@lo:502: 00000100:00100000:3.0:1787579269.786687:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:6707:x1874412616818560:12345-0@lo:502: Request processed in 161us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579269.786701:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787579269.786841:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616818560:0@lo:502: 00000040:00080000:2.0:1787579269.787111:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787579269.787160:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787579269.787194:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787579269.787242:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787579269.787279:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787579269.787329:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787579269.787366:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787579269.787401:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787579269.787447:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787579269.787483:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787579269.787514:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787579269.787576:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787579269.787613:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787579269.787660:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787579269.787709:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787579269.787740:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787579269.787785:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787579269.787831:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787579269.787863:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787579269.787891:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787579269.787963:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787579269.787999:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787579269.788037:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787579269.788090:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787579269.788137:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787579269.788172:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787579269.788238:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787579269.788276:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1787579269.788315:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616818688:0@lo:502: 00000100:00100000:2.0:1787579269.788374:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579269.788395:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce983a3300 going to sleep for 11 seconds 00000100:00100000:0.0:1787579269.788606:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616818688 00000100:00100000:0.0:1787579269.788613:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616818688 00000100:00100000:0.0:1787579269.788652:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787579269.788661:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:6707:x1874412616818688:12345-0@lo:502: 00000100:00100000:0.0:1787579269.788852:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:6707:x1874412616818688:12345-0@lo:502: Request processed in 191us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579269.788859:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787579269.789169:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616818688:0@lo:502: 00000040:00080000:2.0:1787579269.789243:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787579269.789253:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1787579269.789836:0:6731:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787579269.789849:0:6731:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffffa0ceb591b370) 00000020:00000080:2.0:1787579269.789868:0:6731:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1787579269.790023:0:6731:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0ce84eda800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787579269.790027:0:6731:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0ce84eda800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787579269.790029:0:6731:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0ce84eda800 3 00010000:00080000:2.0:1787579269.790063:0:6731:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0cebf6b2800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.153@tcp at head 00010000:00010000:2.0:1787579269.791727:0:6731:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1787579269.792074:0:6731:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787579269.792103:0:6731:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787579269.792114:0:6731:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xb72beeaffa1b6ba1 00000100:00080000:2.0:1787579269.792122:0:6731:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787579269.792127:0:6731:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa0cebf6b2800 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:2.0:1787579269.792158:0:6731:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0cec119d180 x1874412616818816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787579269.792183:0:6731:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787579269.792442:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3318:1874412616818816:0@lo:38: 00000100:00100000:0.0:1787579269.792516:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579269.792638:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616818816 00000100:00100000:2.0:1787579269.792645:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616818816 00000100:00100000:2.0:1787579269.792681:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787579269.792693:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3318:x1874412616818816:12345-0@lo:38: 00010000:00080000:2.0:1787579269.792714:0:5868:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:2.0:1787579269.792749:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xb72beeaffa1b6ba8 00000004:00100000:2.0:1787579269.792762:0:5868:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787579269.792801:0:5868:0:(import.c:65:import_set_state_nolock()) ffffa0cebf6b3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787579269.792854:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874412616818816:12345-0@lo:38: Request processed in 160us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579269.792861:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:2.0:1787579269.793051:0:6731:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00010000:00080000:0.0:1787579269.793102:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0cec119d180 x1874412616818816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787579279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579269.793130:0:3318:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787579269.793137:0:3318:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1787579269.793144:0:3318:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787579269.793147:0:3318:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787579269.793149:0:3318:0:(import.c:65:import_set_state_nolock()) ffffa0cebf6b2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787579269.793155:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3318:1874412616818816:0@lo:38: 00000020:01000000:2.0:1787579269.794433:0:6707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1787579269.794466:0:6707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787579269.794485:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce813fda00/0xb72beeaffa1b6b8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6b93 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579269.794496:0:6707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce813fda00/0xb72beeaffa1b6b8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6b93 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787579269.794605:0:6707:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787579269.794607:0:6707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787579269.794609:0:6707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787579269.794610:0:6707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787579269.794611:0:6707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787579269.794613:0:6707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787579269.794614:0:6707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787579269.794615:0:6707:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787579269.794617:0:6707:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787579269.794618:0:6707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787579269.794619:0:6707:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787579269.794623:0:6707:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1787579269.794626:0:6707:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787579269.794627:0:6707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787579269.794628:0:6707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787579269.794635:0:6707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787579269.794635:0:6707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787579269.794636:0:6707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787579269.794637:0:6707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787579269.794638:0:6707:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787579269.794639:0:6707:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787579269.794640:0:6707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787579269.794641:0:6707:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787579269.794663:0:6707:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787579269.794678:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616818944:0@lo:253: 00000100:00100000:2.0:1787579269.794744:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579269.794792:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce983a33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787579269.795494:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616818944 00000100:00100000:0.0:1787579269.795503:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616818944 00000100:00100000:0.0:1787579269.795554:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787579269.795562:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:6707:x1874412616818944:12345-0@lo:253: 20000000:01000000:0.0:1787579269.795589:0:5860:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787579269.795602:0:5860:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787579269.823109:0:5860:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787579269.823127:0:5860:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787579269.823181:0:5882:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787579269.823187:0:5882:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787579269.823208:0:5882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0ce8148bc00/0xb72beeaffa1b6baf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579269.823226:0:5882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ce813fc200/0xb72beeaffa1b6b07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6b00 expref: 13 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579269.823233:0:5882:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0ce8148bc00/0xb72beeaffa1b6baf lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579269.823271:0:5882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ce813fc200/0xb72beeaffa1b6b07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b6b00 expref: 13 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579269.823286:0:5882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0ce813fc200/0xb72beeaffa1b6b07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b6b00 expref: 13 pid: 5859 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579269.823318:0:5882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5882:1874412616819072:0@lo:104: 00000100:00100000:1.0:1787579269.823377:0:5882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579269.823432:0:5882:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce97767300 going to sleep for 11 seconds 00000100:00100000:0.0:1787579269.823506:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616819072 00000100:00100000:0.0:1787579269.823513:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616819072 00000100:00100000:0.0:1787579269.823564:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787579269.823573:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+3:5882:x1874412616819072:12345-0@lo:104: 00010000:00010000:0.0:1787579269.823585:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ce80031c00/0xb72beeaffa1b6b00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6b07 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579269.823637:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787579269.823643:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+3:5882:x1874412616819072:12345-0@lo:104: Request processed in 71us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579269.823649:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787579269.823669:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787579269.823675:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce80031c00/0xb72beeaffa1b6b00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6b07 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579269.823688:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce80031c00 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:0.0:1787579269.823692:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce80031c00/0xb72beeaffa1b6b00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b6b07 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579269.823701:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce80031c00/0xb72beeaffa1b6b00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b6b07 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787579269.823708:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce80031c00/0xb72beeaffa1b6b00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b6b07 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579269.823713:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787579269.823739:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ce80031c00/0xb72beeaffa1b6b00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6b07 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579269.823745:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787579269.823759:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce80031c00/0xb72beeaffa1b6b00 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6b07 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579269.823765:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce80031c00/0xb72beeaffa1b6b00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6b07 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579269.823799:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579269.823801:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579269.823803:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579269.823823:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616819200:0@lo:103: 00000100:00100000:0.0:1787579269.823852:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579269.823884:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616819200 00000100:00100000:0.0:1787579269.823888:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616819200 00010000:00010000:0.0:1787579269.823904:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ce813fc200/0xb72beeaffa1b6b07 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6b00 expref: 14 pid: 5859 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579269.824190:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787579269.824199:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce90ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:3322:x1874412616819200:12345-0@lo:103: 00010000:00010000:0.0:1787579269.824210:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579269.824216:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ce813fc200/0xb72beeaffa1b6b07 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6b00 expref: 14 pid: 5859 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579269.824225:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ce813fc200/0xb72beeaffa1b6b07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b6b00 expref: 14 pid: 5859 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579269.824240:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0ce8148bc00/0xb72beeaffa1b6baf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579269.824248:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce8148bc00/0xb72beeaffa1b6baf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787579269.824260:0:5851:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002724517s 00010000:00010000:0.0:1787579269.824265:0:5851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0ce8148bc00/0xb72beeaffa1b6baf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579269.824271:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0ce8148bc00/0xb72beeaffa1b6baf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579269.824277:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0ce8148bc00/0xb72beeaffa1b6baf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579269.824283:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0ce8148bc00/0xb72beeaffa1b6baf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579269.824288:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148bc00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:0.0:1787579269.824292:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0ce8148bc00/0xb72beeaffa1b6baf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579269.824305:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0ce8148bc00/0xb72beeaffa1b6baf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579269.824314:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0ce8148bc00/0xb72beeaffa1b6baf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579269.824323:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579269.824358:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce90ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:3322:x1874412616819200:12345-0@lo:103: Request processed in 161us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579269.824366:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787579269.824424:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616819200:0@lo:103: 00010000:00010000:0.0:1787579269.824450:0:5882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce813fc200/0xb72beeaffa1b6b07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b6b00 expref: 13 pid: 5859 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579269.824460:0:5882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5882:1874412616819072:0@lo:104: 00010000:00010000:0.0:1787579269.824471:0:5882:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0ce8148bc00/0xb72beeaffa1b6baf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579269.824479:0:5882:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0ce8148bc00/0xb72beeaffa1b6baf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579269.824486:0:5882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0ce8148bc00/0xb72beeaffa1b6baf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579269.824492:0:5882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce8148bc00/0xb72beeaffa1b6baf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579269.830290:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:6707:x1874412616818944:12345-0@lo:253: Request processed in 34719us (35536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579269.830305:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787579269.830403:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:6707:1874412616818944:0@lo:253: 10000000:01000000:0.0:1787579269.830434:0:6707:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787579269.830437:0:6707:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787579269.830439:0:6707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787579269.830441:0:6707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787579269.830442:0:6707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787579269.830443:0:6707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787579269.830444:0:6707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787579269.830446:0:6707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787579269.830448:0:6707:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787579269.830449:0:6707:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787579269.830451:0:6707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787579269.830452:0:6707:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787579269.830466:0:6707:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787579269.835161:0:6707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787579269.835365:0:6707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787579269.835704:0:6707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787579269.835893:0:6707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787579269.836270:0:6707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787579269.836489:0:6707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787579269.837423:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787579270.018675:0:6707:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787579270.018684:0:6707:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787579270.018786:0:6707:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787579270.018840:0:6707:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.153@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787579270.018855:0:6707:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787579270.018872:0:6707:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1787579270.572047:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579271.588145:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579272.608131:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579273.637062:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579274.657054:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579275.239897:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616819328:0@lo:400: 00000100:00100000:3.0:1787579275.239997:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579275.240042:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874412616819456:0@lo:400: 00000100:00100000:0.0:1787579275.240072:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579275.240146:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616819328 00000100:00100000:1.0:1787579275.240154:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616819328 00000100:00100000:1.0:1787579275.240198:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787579275.240207:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:3319:x1874412616819328:12345-0@lo:400: 00000100:00100000:1.0:1787579275.240258:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:3319:x1874412616819328:12345-0@lo:400: Request processed in 52us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579275.240264:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787579275.240980:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616819328:0@lo:400: 00000100:00100000:0.0:1787579275.241838:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616819584:0@lo:400: 00000100:00100000:0.0:1787579275.241877:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579275.255602:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616819456 00000100:00100000:3.0:1787579275.255615:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616819456 00000100:00100000:3.0:1787579275.255684:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616819584 00000100:00100000:3.0:1787579275.255688:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616819584 00000100:00100000:3.0:1787579275.255722:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787579275.255731:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874412616819456:12345-0@lo:400: 00000100:00100000:3.0:1787579275.255827:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874412616819456:12345-0@lo:400: Request processed in 97us (15753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579275.255834:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787579275.255852:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787579275.255859:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616819584:12345-0@lo:400: 00000100:00100000:3.0:1787579275.255890:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616819584:12345-0@lo:400: Request processed in 32us (14013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579275.255895:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787579275.255950:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787579275.255984:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ceb480f100 x1874412616819456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579275.255999:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874412616819456:0@lo:400: 00010000:00080000:3.0:1787579275.256036:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ceb480df80 x1874412616819584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579275.256059:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616819584:0@lo:400: 00000001:02000400:3.0:1787579275.322718:0:7074:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg653-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787579275.680389:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579276.704119:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787579277.280290:0:5863:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787579277.280298:0:5863:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0ce90be4800 from 21 10000000:01000000:0.0:1787579277.280302:0:5863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787579277.280354:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce80031c00/0xb72beeaffa1b6bb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579277.280367:0:5863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ce80031c00/0xb72beeaffa1b6bb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579277.280377:0:5863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce80031c00/0xb72beeaffa1b6bb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579277.280399:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616819712:0@lo:101: 00000100:00100000:0.0:1787579277.280648:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579277.280721:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cebf8046c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787579277.280845:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616819712 00000100:00100000:2.0:1787579277.280852:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616819712 00000100:00100000:2.0:1787579277.280899:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787579277.280908:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:5863:x1874412616819712:12345-0@lo:101: 00010000:00010000:2.0:1787579277.280919:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579277.280947:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce813fc000/0xb72beeaffa1b6bbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6bb6 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579277.280969:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce813fc000/0xb72beeaffa1b6bbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6bb6 expref: 13 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579277.280980:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce813fc000/0xb72beeaffa1b6bbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6bb6 expref: 13 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579277.280999:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce813fc000, rc 0) 00000100:00100000:2.0:1787579277.281049:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:5863:x1874412616819712:12345-0@lo:101: Request processed in 142us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579277.281057:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787579277.282169:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616819712:0@lo:101: 00010000:00010000:0.0:1787579277.282190:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce80031c00/0xb72beeaffa1b6bb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6bbd expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579277.282201:0:5863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce80031c00/0xb72beeaffa1b6bb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6bbd expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579277.282265:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616819840:0@lo:501: 00000100:00100000:0.0:1787579277.282302:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579277.282396:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cebf8046c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787579277.283637:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616819840 00000100:00100000:2.0:1787579277.283646:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616819840 00000100:00100000:2.0:1787579277.283703:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787579277.283712:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:5863:x1874412616819840:12345-0@lo:501: 00000100:00100000:2.0:1787579277.284117:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:5863:x1874412616819840:12345-0@lo:501: Request processed in 405us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579277.284125:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787579277.286760:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616819840:0@lo:501: 00000100:00100000:0.0:1787579277.286819:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616819968:0@lo:503: 00000100:00100000:0.0:1787579277.286892:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579277.286963:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cebf8046c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787579277.287037:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616819968 00000100:00100000:3.0:1787579277.287044:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616819968 00000100:00100000:3.0:1787579277.287094:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787579277.287103:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:5863:x1874412616819968:12345-0@lo:503: 00000100:00100000:3.0:1787579277.287434:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:5863:x1874412616819968:12345-0@lo:503: Request processed in 331us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579277.287441:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787579277.287676:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616819968:0@lo:503: 00000100:00100000:0.0:1787579277.293867:0:7178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7178:1874412616820096:0@lo:502: 00000100:00100000:0.0:1787579277.293981:0:7178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579277.294010:0:7178:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cebf804240 going to sleep for 11 seconds 00000100:00100000:1.0:1787579277.294106:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616820096 00000100:00100000:1.0:1787579277.294113:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616820096 00000100:00100000:1.0:1787579277.294149:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787579277.294157:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:7178:x1874412616820096:12345-0@lo:502: 00000100:00100000:1.0:1787579277.294419:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:7178:x1874412616820096:12345-0@lo:502: Request processed in 262us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579277.294434:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787579277.294677:0:7178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7178:1874412616820096:0@lo:502: 00000100:00100000:0.0:1787579277.294722:0:7178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7178:1874412616820224:0@lo:502: 00000100:00100000:0.0:1787579277.294768:0:7178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579277.294796:0:7178:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cebf804240 going to sleep for 11 seconds 00000100:00100000:2.0:1787579277.294851:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616820224 00000100:00100000:2.0:1787579277.294855:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616820224 00000100:00100000:2.0:1787579277.294885:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787579277.294891:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb1d50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:7178:x1874412616820224:12345-0@lo:502: 00000100:00100000:2.0:1787579277.295035:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb1d50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:7178:x1874412616820224:12345-0@lo:502: Request processed in 144us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579277.295041:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787579277.295111:0:7178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7178:1874412616820224:0@lo:502: 00000040:00080000:0.0:1787579277.295128:0:7178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1787579277.295269:0:5863:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1787579277.295284:0:5863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787579277.295292:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce80031c00/0xb72beeaffa1b6bb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6bbd expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579277.295303:0:5863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce80031c00/0xb72beeaffa1b6bb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6bbd expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579277.295322:0:5863:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787579277.295325:0:5863:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0ce90be4800 from 4 10000000:01000000:2.0:1787579277.295327:0:5863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787579277.295352:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce813fcc00/0xb72beeaffa1b6bc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579277.295360:0:5863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ce813fcc00/0xb72beeaffa1b6bc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579277.295369:0:5863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce813fcc00/0xb72beeaffa1b6bc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579277.295380:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616820352:0@lo:101: 00000100:00100000:2.0:1787579277.295405:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579277.295439:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceba1e0300 going to sleep for 11 seconds 00000100:00100000:0.0:1787579277.297643:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616820352 00000100:00100000:0.0:1787579277.297654:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616820352 00000100:00100000:0.0:1787579277.297697:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787579277.297706:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb1d53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:5863:x1874412616820352:12345-0@lo:101: 00010000:00010000:0.0:1787579277.297720:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579277.297748:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce80030c00/0xb72beeaffa1b6bcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6bc4 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579277.297773:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce80030c00/0xb72beeaffa1b6bcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6bc4 expref: 14 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579277.297783:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce80030c00/0xb72beeaffa1b6bcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6bc4 expref: 14 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579277.297791:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce80030c00, rc 0) 00000100:00100000:0.0:1787579277.297859:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb1d53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:5863:x1874412616820352:12345-0@lo:101: Request processed in 153us (2452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579277.297865:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787579277.298203:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616820352:0@lo:101: 00010000:00010000:2.0:1787579277.298219:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce813fcc00/0xb72beeaffa1b6bc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6bcb expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579277.298227:0:5863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce813fcc00/0xb72beeaffa1b6bc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6bcb expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579277.298286:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616820480:0@lo:256: 00000100:00100000:2.0:1787579277.298320:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579277.298351:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceba1e0300 going to sleep for 11 seconds 00000100:00100000:0.0:1787579277.298400:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616820480 00000100:00100000:0.0:1787579277.298404:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616820480 00000100:00100000:0.0:1787579277.298570:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787579277.298586:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb1d53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:5863:x1874412616820480:12345-0@lo:256: 20000000:01000000:0.0:1787579277.298598:0:5861:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787579277.298613:0:5861:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787579277.298616:0:5861:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1787579277.298691:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb1d53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:5863:x1874412616820480:12345-0@lo:256: Request processed in 114us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579277.298696:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787579277.298760:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616820480:0@lo:256: 10000000:01000000:2.0:1787579277.298796:0:5863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787579277.298805:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce813fcc00/0xb72beeaffa1b6bc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6bcb expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579277.298812:0:5863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce813fcc00/0xb72beeaffa1b6bc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6bcb expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579277.298819:0:5863:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787579277.298822:0:5863:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787579277.298824:0:5863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787579277.298842:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc400/0xb72beeaffa1b6bd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579277.298849:0:5863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc400/0xb72beeaffa1b6bd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579277.298856:0:5863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc400/0xb72beeaffa1b6bd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579277.298866:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616820608:0@lo:101: 00000100:00100000:2.0:1787579277.298888:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579277.314324:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce92d59000 going to sleep for 11 seconds 00000100:00100000:1.0:1787579277.326415:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616820608 00000100:00100000:1.0:1787579277.326431:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616820608 00000100:00100000:1.0:1787579277.326508:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787579277.326518:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce857d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:5863:x1874412616820608:12345-0@lo:101: 00010000:00010000:1.0:1787579277.326534:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579277.326552:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce8148a200/0xb72beeaffa1b6bd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6bd2 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579277.326579:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce8148a200/0xb72beeaffa1b6bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6bd2 expref: 15 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579277.326590:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce8148a200/0xb72beeaffa1b6bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6bd2 expref: 15 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579277.326599:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8148a200, rc 0) 00000100:00100000:1.0:1787579277.326686:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce857d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:5863:x1874412616820608:12345-0@lo:101: Request processed in 169us (27796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579277.326693:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787579277.327017:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616820608:0@lo:101: 00010000:00010000:2.0:1787579277.327036:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc400/0xb72beeaffa1b6bd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6bd9 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579277.327047:0:5863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc400/0xb72beeaffa1b6bd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6bd9 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579277.327133:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616820736:0@lo:501: 00000100:00100000:2.0:1787579277.327183:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579277.327216:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce92d59000 going to sleep for 11 seconds 00000100:00100000:1.0:1787579277.331612:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616820736 00000100:00100000:1.0:1787579277.331630:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616820736 00000100:00100000:1.0:1787579277.331704:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787579277.331716:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce857d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:5863:x1874412616820736:12345-0@lo:501: 00000100:00100000:0.0:1787579277.332204:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce857d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:5863:x1874412616820736:12345-0@lo:501: Request processed in 487us (5018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579277.332219:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787579277.332325:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616820736:0@lo:501: 00000100:00100000:2.0:1787579277.332369:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616820864:0@lo:503: 00000100:00100000:2.0:1787579277.332410:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579277.332443:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce92d59000 going to sleep for 11 seconds 00000100:00100000:0.0:1787579277.333353:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616820864 00000100:00100000:0.0:1787579277.333362:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616820864 00000100:00100000:0.0:1787579277.333416:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787579277.333425:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:5863:x1874412616820864:12345-0@lo:503: 00000100:00100000:0.0:1787579277.333891:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:5863:x1874412616820864:12345-0@lo:503: Request processed in 466us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579277.333899:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787579277.334038:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616820864:0@lo:503: 00000100:00100000:2.0:1787579277.335120:0:7179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7179:1874412616820992:0@lo:502: 00000100:00100000:2.0:1787579277.335184:0:7179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579277.335227:0:7179:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce92d599c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787579277.335279:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616820992 00000100:00100000:0.0:1787579277.335286:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616820992 00000100:00100000:0.0:1787579277.335326:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787579277.335335:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84e09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:7179:x1874412616820992:12345-0@lo:502: 00000100:00100000:0.0:1787579277.335767:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84e09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:7179:x1874412616820992:12345-0@lo:502: Request processed in 432us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579277.335776:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787579277.336234:0:7179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7179:1874412616820992:0@lo:502: 00000020:01000000:1.0:1787579277.336271:0:7179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787579277.336285:0:7179:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787579277.336292:0:7179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579277.336294:0:7179:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787579277.336299:0:7179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787579277.336303:0:7179:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.153@tcp to nid 0x20000c0a8ce99 (192.168.206.153@tcp) 00000020:01000000:1.0:1787579277.336328:0:7179:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787579277.336332:0:7179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787579277.336347:0:7179:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffffa0ce8674cd28) 00000020:00000080:1.0:1787579277.336368:0:7179:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1787579277.336375:0:7179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787579277.336467:0:7179:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787579277.336484:0:7179:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787579277.336491:0:7179:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb72beeaffa1b6be7 00010000:00080000:1.0:1787579277.336524:0:7179:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0cebf39d800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.153@tcp at head 00010000:00010000:1.0:1787579277.336780:0:7179:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787579277.401895:0:7179:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787579277.401916:0:7179:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787579277.403055:0:7179:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787579277.403246:0:7179:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787579277.403297:0:7179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787579277.403359:0:7179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787579277.403964:0:7182:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787579277.403969:0:7182:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787579277.404812:0:7179:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787579277.404825:0:7179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787579277.404856:0:7179:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787579277.404877:0:7179:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb72beeaffa1b6bee 00000100:00080000:0.0:1787579277.404887:0:7179:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787579277.404892:0:7179:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa0cebf39d800 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:0.0:1787579277.405000:0:7179:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ce830ef100 x1874412616821120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787579277.405063:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616821120:0@lo:8: 00000100:00100000:1.0:1787579277.405131:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787579277.405179:0:7179:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787579277.405243:0:7179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787579277.405247:0:7179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579277.405249:0:7179:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787579277.405252:0:7179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787579277.405256:0:7179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579277.405258:0:7179:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787579277.405260:0:7179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787579277.405262:0:7179:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787579277.405286:0:7179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830edf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7179:1874412616821248:0@lo:502: 00000100:00100000:0.0:1787579277.405330:0:7179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579277.405364:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616821248 00000100:00100000:0.0:1787579277.405370:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616821248 00000100:00100000:0.0:1787579277.405404:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787579277.405413:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84e0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:7179:x1874412616821248:12345-0@lo:502: 00000100:00100000:3.0:1787579277.405622:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787579277.405631:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616821376:0@lo:400: 00000100:00100000:3.0:1787579277.405659:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579277.405703:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616821504:0@lo:400: 00000100:00100000:3.0:1787579277.405739:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579277.405779:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616821376 00000100:00100000:3.0:1787579277.405784:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616821376 00000100:00100000:3.0:1787579277.405810:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616821504 00000100:00100000:3.0:1787579277.405813:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616821504 00000100:00100000:3.0:1787579277.405837:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787579277.405842:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616821376:12345-0@lo:400: 00000100:00100000:3.0:1787579277.405883:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616821376:12345-0@lo:400: Request processed in 40us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579277.405890:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787579277.405912:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787579277.405919:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616821504:12345-0@lo:400: 00000100:00100000:3.0:1787579277.405970:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616821504:12345-0@lo:400: Request processed in 52us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579277.405976:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787579277.405996:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787579277.406019:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ce84f15880 x1874412616821504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579277.406031:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616821504:0@lo:400: 00010000:00080000:3.0:1787579277.406058:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ce84f14e00 x1874412616821376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579277.406067:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616821376:0@lo:400: 00000100:00100000:0.0:1787579277.409426:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84e0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:7179:x1874412616821248:12345-0@lo:502: Request processed in 4004us (4086us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579277.409442:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787579277.409835:0:7179:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cebf804f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787579277.409860:0:7179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830edf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7179:1874412616821248:0@lo:502: 00000020:01000000:0.0:1787579277.409891:0:7179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787579277.409898:0:7179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579277.409900:0:7179:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787579277.409904:0:7179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1787579277.409985:0:5863:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1787579277.409999:0:5863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787579277.410009:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc400/0xb72beeaffa1b6bd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6bd9 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579277.410040:0:5863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc400/0xb72beeaffa1b6bd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6bd9 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579277.410049:0:5863:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787579277.410051:0:5863:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa0ce98720000 from 1 10000000:01000000:0.0:1787579277.410054:0:5863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787579277.410085:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce80031400/0xb72beeaffa1b6bf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579277.410093:0:5863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ce80031400/0xb72beeaffa1b6bf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579277.410102:0:5863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce80031400/0xb72beeaffa1b6bf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579277.410119:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830edf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616821632:0@lo:101: 00000100:00100000:0.0:1787579277.410157:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579277.410184:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84d07240 going to sleep for 11 seconds 00000100:00100000:0.0:1787579277.410200:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616821632 00000100:00100000:0.0:1787579277.410205:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616821632 00000100:00100000:0.0:1787579277.410234:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787579277.410242:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:5863:x1874412616821632:12345-0@lo:101: 00010000:00010000:0.0:1787579277.410253:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579277.410277:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceb3f78000/0xb72beeaffa1b6bfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6bf5 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579277.410299:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceb3f78000/0xb72beeaffa1b6bfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6bf5 expref: 16 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579277.410321:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceb3f78000/0xb72beeaffa1b6bfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6bf5 expref: 16 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579277.410330:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb3f78000, rc 0) 00000100:00100000:0.0:1787579277.410362:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:5863:x1874412616821632:12345-0@lo:101: Request processed in 120us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579277.410368:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787579277.410401:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830edf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616821632:0@lo:101: 00010000:00010000:0.0:1787579277.410412:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce80031400/0xb72beeaffa1b6bf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6bfc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579277.410420:0:5863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce80031400/0xb72beeaffa1b6bf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6bfc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579277.410459:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830edf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616821760:0@lo:501: 00000100:00100000:0.0:1787579277.411082:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579277.411282:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84d07240 going to sleep for 11 seconds 00000100:00100000:0.0:1787579277.412438:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616821120 00000100:00100000:0.0:1787579277.412449:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616821120 00000100:00100000:2.0:1787579277.412635:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787579277.412644:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3318:x1874412616821120:12345-0@lo:8: 00010000:00080000:2.0:1787579277.412672:0:6711:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:2.0:1787579277.412701:0:6711:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb72beeaffa1b6c03 00002000:00100000:2.0:1787579277.412753:0:6711:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffffa0cebf6b5000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787579277.412757:0:6711:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1787579277.412761:0:6711:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787579277.412872:0:6711:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787579277.413043:0:6711:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787579277.413068:0:6711:0:(import.c:65:import_set_state_nolock()) ffffa0cebf6b4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787579277.413151:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1874412616821120:12345-0@lo:8: Request processed in 506us (8019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579277.413159:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787579277.413854:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616821760 00000100:00100000:1.0:1787579277.413863:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616821760 00000100:00100000:1.0:1787579277.413950:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787579277.413960:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce85749850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:5863:x1874412616821760:12345-0@lo:501: 00000100:00100000:1.0:1787579277.414263:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce85749850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:5863:x1874412616821760:12345-0@lo:501: Request processed in 305us (3764us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787579277.414271:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787579277.414355:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830edf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616821760:0@lo:501: 10000000:01000000:2.0:1787579277.414389:0:5863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787579277.414405:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce80031400/0xb72beeaffa1b6bf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6bfc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579277.414415:0:5863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce80031400/0xb72beeaffa1b6bf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6bfc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1787579277.414761:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ce830ef100 x1874412616821120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787579287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579277.414772:0:3318:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787579277.414779:0:3318:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787579277.414785:0:3318:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787579277.414797:0:3318:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787579277.414800:0:3318:0:(import.c:65:import_set_state_nolock()) ffffa0cebf39d800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787579277.414863:0:3318:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787579277.414869:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616821120:0@lo:8: 00000004:00080000:2.0:1787579277.414947:0:7182:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787579277.415047:0:7182:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 213606120440ns, next at 0ns, rc = 0 00000004:00080000:3.0:1787579277.455889:0:5888:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1787579277.479749:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616821888:0@lo:13: 00000100:00100000:3.0:1787579277.479823:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787579277.479896:0:7183:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787579277.479920:0:7183:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7183:1874412616822016:0@lo:7: 00000100:00100000:1.0:1787579277.479968:0:7183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579277.479994:0:7183:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce87b7f480 going to sleep for 11 seconds 00000100:00100000:2.0:1787579277.480141:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616822016 00000100:00100000:2.0:1787579277.480148:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616822016 00000100:00100000:2.0:1787579277.480218:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787579277.480228:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7183:x1874412616822016:12345-0@lo:7: 00000100:00100000:0.0:1787579277.480614:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616821888 00000100:00100000:0.0:1787579277.480619:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616821888 00000100:00100000:0.0:1787579277.480650:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787579277.480657:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1874412616821888:12345-0@lo:13: 00002000:00000024:0.0:1787579277.480680:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00080000:1.0:1787579277.480758:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787579277.484645:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1874412616821888:12345-0@lo:13: Request processed in 3981us (4814us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579277.484659:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787579277.486049:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ceb480fb80 x1874412616821888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579277.486074:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616821888:0@lo:13: 00002000:00080000:2.0:1787579277.486632:0:6712:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1787579277.486639:0:6712:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787579277.486789:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7183:x1874412616822016:12345-0@lo:7: Request processed in 6561us (6819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579277.486799:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787579277.486873:0:7183:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ceb480ed80 x1874412616822016/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787579293 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579277.486885:0:7183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7183:1874412616822016:0@lo:7: 00000004:00080000:1.0:1787579277.486896:0:7183:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787579277.487001:0:7183:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7183:1874412616822144:0@lo:5: 00000100:00100000:1.0:1787579277.487034:0:7183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579277.487105:0:7183:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce87b7f480 going to sleep for 11 seconds 00000100:00100000:0.0:1787579277.487143:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616822144 00000100:00100000:0.0:1787579277.487150:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616822144 00000100:00100000:0.0:1787579277.487226:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787579277.487236:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7183:x1874412616822144:12345-0@lo:5: 00002000:00080000:0.0:1787579277.487257:0:6710:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787579277.487261:0:6710:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787579277.487504:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7183:x1874412616822144:12345-0@lo:5: Request processed in 262us (461us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787579277.487511:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787579277.487568:0:7183:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ceb480ed80 x1874412616822144/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787579293 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579277.487579:0:7183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7183:1874412616822144:0@lo:5: 00000004:00080000:1.0:1787579277.487588:0:7183:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787579277.487613:0:7183:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7183:1874412616822272:0@lo:700: 00000100:00100000:1.0:1787579277.487640:0:7183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579277.487669:0:7183:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce87b7f480 going to sleep for 11 seconds 00000100:00100000:3.0:1787579277.487851:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616822272 00000100:00100000:3.0:1787579277.487857:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616822272 00000100:00100000:3.0:1787579277.487908:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787579277.487916:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7183:x1874412616822272:12345-0@lo:700: 00000100:00100000:3.0:1787579277.487965:0:6718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f15880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6718:1874412616822400:0@lo:700: 00000100:00100000:3.0:1787579277.487996:0:6718:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579277.488012:0:6718:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce98663000 going to sleep for 11 seconds 00000100:00100000:1.0:1787579277.488092:0:5873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616822400 00000100:00100000:1.0:1787579277.488097:0:5873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616822400 00000100:00100000:1.0:1787579277.488139:0:5873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787579277.488146:0:5873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6718:x1874412616822400:12345-0@lo:700: 40000000:02000000:1.0:1787579277.523119:0:5873:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1787579277.527031:0:5873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6718:x1874412616822400:12345-0@lo:700: Request processed in 38878us (39026us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579277.527043:0:5873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787579277.527301:0:6718:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ce84f15880 x1874412616822400/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787579293 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579277.527315:0:6718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f15880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6718:1874412616822400:0@lo:700: 40000000:02000000:3.0:1787579277.527338:0:6718:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:0.0:1787579277.576420:0:6735:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1787579277.576611:0:6735:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787579277.576806:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7183:x1874412616822272:12345-0@lo:700: Request processed in 88887us (89161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579277.576817:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787579277.576902:0:7183:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ceb480df80 x1874412616822272/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787579293 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579277.576914:0:7183:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787579277.576950:0:7183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7183:1874412616822272:0@lo:700: 00000004:02000040:1.0:1787579277.597906:0:7183:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1787579277.601370:0:7183:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7183:1874412616822528:0@lo:5: 00000100:00100000:1.0:1787579277.601435:0:7183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579277.601563:0:7183:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce977676c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787579277.601710:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616822528 00000100:00100000:2.0:1787579277.601718:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616822528 00000100:00100000:2.0:1787579277.601811:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787579277.601821:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7183:x1874412616822528:12345-0@lo:5: 00002000:00080000:3.0:1787579277.607220:0:6711:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787579277.607240:0:6711:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1787579277.610335:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7183:x1874412616822528:12345-0@lo:5: Request processed in 8509us (8893us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787579277.610351:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787579277.610894:0:7183:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ceb480df80 x1874412616822528/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787579293 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579277.610911:0:7183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7183:1874412616822528:0@lo:5: 00000004:00080000:1.0:1787579277.610992:0:7183:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1787579277.731266:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579278.764363:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787579279.753824:0:6735:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1787579279.777278:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579280.800060:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579281.824622:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579282.860115:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579282.916781:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616822656:0@lo:400: 00000100:00100000:3.0:1787579282.916850:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579282.916901:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787579282.916908:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616822784:0@lo:400: 00000100:00100000:3.0:1787579282.916957:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579282.916986:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616822912:0@lo:400: 00000100:00100000:3.0:1787579282.917008:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579282.917025:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787579282.917030:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616823040:0@lo:400: 00000100:00100000:3.0:1787579282.917053:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579282.917083:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616822656 00000100:00100000:3.0:1787579282.917089:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616822656 00000100:00100000:3.0:1787579282.917125:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787579282.917134:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce85749050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:3321:x1874412616822656:12345-0@lo:400: 00000100:00100000:3.0:1787579282.917180:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce85749050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:3321:x1874412616822656:12345-0@lo:400: Request processed in 46us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579282.917198:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787579282.917230:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616822784 00000100:00100000:3.0:1787579282.917233:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616822784 00000100:00100000:3.0:1787579282.917254:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616822912 00000100:00100000:3.0:1787579282.917257:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616822912 00000100:00100000:3.0:1787579282.917278:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787579282.917284:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616822784:12345-0@lo:400: 00000100:00100000:3.0:1787579282.918307:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616822784:12345-0@lo:400: Request processed in 1019us (1345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579282.918327:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787579282.918349:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787579282.918358:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616822912:12345-0@lo:400: 00000100:00100000:3.0:1787579282.918399:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616822912:12345-0@lo:400: Request processed in 43us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579282.918405:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787579282.918447:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ce84f16a00 x1874412616822784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579282.918460:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616822784:0@lo:400: 00000100:00100000:3.0:1787579282.918484:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616822656:0@lo:400: 00010000:00080000:3.0:1787579282.918516:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ce84f15180 x1874412616822912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579282.918525:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616822912:0@lo:400: 00000100:00080000:1.0:1787579282.918768:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579282.918983:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616823040 00000100:00100000:0.0:1787579282.918989:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616823040 00000100:00100000:0.0:1787579282.919025:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787579282.919032:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616823040:12345-0@lo:400: 00000100:00100000:0.0:1787579282.919072:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616823040:12345-0@lo:400: Request processed in 41us (2019us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579282.919078:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787579282.919101:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787579282.919111:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616823168:0@lo:13: 00000100:00100000:0.0:1787579282.919144:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787579282.919180:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ce84f14a80 x1874412616823040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579282.919188:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787579282.919199:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616823040:0@lo:400: 00000100:00080000:0.0:1787579282.919224:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787579282.919239:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616823168 00000100:00100000:0.0:1787579282.919255:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616823168 00000100:00100000:0.0:1787579282.919280:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787579282.919286:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616823168:12345-0@lo:13: 00002000:00000024:0.0:1787579282.919322:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579282.919358:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616823168:12345-0@lo:13: Request processed in 73us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579282.919364:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787579282.919389:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ce830ec700 x1874412616823168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579282.919403:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616823168:0@lo:13: 00010000:00010000:1.0:1787579283.874412:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579284.897014:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579285.927971:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579286.944079:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787579287.163115:0:7649:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787579287.163124:0:7649:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787579287.163502:0:7649:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa0ceb3138000 00000020:01000004:3.0:1787579287.163518:0:7649:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787579287.163529:0:7649:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787579287.163548:0:7649:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffffa0cec1bf0000) 00000020:00000080:3.0:1787579287.163563:0:7649:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787579287.191023:0:7649:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1787579287.191359:0:7649:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1787579287.212560:0:7649:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1787579287.218586:0:7649:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787579287.218619:0:7649:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1787579287.218689:0:7649:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787579287.218954:0:7649:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1787579287.219454:0:7649:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787579287.219465:0:7649:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787579287.219477:0:7649:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb72beeaffa1b6c11 00000020:01000004:1.0:1787579287.219484:0:7649:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1787579287.219505:0:7649:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.153@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787579287.219508:0:7649:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787579287.219514:0:7649:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787579287.219533:0:7649:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1787579287.219536:0:7649:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.153@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787579287.239407:0:7649:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.153@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787579287.239454:0:7649:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.153@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1787579287.239458:0:7649:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787579287.239460:0:7649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787579287.239461:0:7649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787579287.239462:0:7649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787579287.239464:0:7649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787579287.239465:0:7649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787579287.239467:0:7649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787579287.239468:0:7649:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787579287.239470:0:7649:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787579287.239471:0:7649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787579287.239472:0:7649:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787579287.239475:0:7649:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1787579287.239477:0:7649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787579287.239478:0:7649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787579287.239479:0:7649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787579287.239480:0:7649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787579287.239481:0:7649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787579287.239486:0:7649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787579287.239487:0:7649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787579287.239488:0:7649:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787579287.239489:0:7649:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787579287.239490:0:7649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787579287.239491:0:7649:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787579287.239521:0:7649:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787579287.239537:0:7649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616823296:0@lo:253: 00000100:00100000:1.0:1787579287.239600:0:7649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579287.239728:0:7649:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce983a3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787579287.239810:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616823296 00000100:00100000:0.0:1787579287.239816:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616823296 00000100:00100000:0.0:1787579287.239905:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787579287.239914:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce85748450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:7649:x1874412616823296:12345-0@lo:253: 20000000:01000000:0.0:1787579287.239968:0:5861:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787579287.239972:0:5861:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1787579287.239977:0:5861:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1787579287.239980:0:5861:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1787579287.240875:0:5861:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787579287.241095:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1787579287.241108:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1787579287.241146:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1787579287.241155:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1787579287.241184:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1787579287.241242:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1787579287.241569:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1787579287.241591:0:5861:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.153@tcp 20000000:01000000:0.0:1787579287.241593:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.153@tcp (null) (null) (null) 00000040:00080000:0.0:1787579287.241634:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1787579287.241655:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787579287.241720:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1787579287.241729:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.153@tcp (null) (null) 00000040:00080000:0.0:1787579287.241763:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1787579287.241784:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787579287.241817:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1787579287.241865:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1787579287.242615:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1787579287.242631:0:5861:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.153@tcp 20000000:01000000:0.0:1787579287.242633:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.153@tcp (null) (null) (null) 00000040:00080000:0.0:1787579287.242664:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1787579287.242683:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787579287.242843:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1787579287.242853:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.153@tcp (null) (null) 00000040:00080000:0.0:1787579287.242885:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1787579287.242894:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787579287.242953:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1787579287.242991:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1787579287.243007:0:5861:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787579287.243010:0:5861:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787579287.243013:0:5861:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787579287.243024:0:5861:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787579287.243027:0:5861:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787579287.243057:0:5861:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787579287.243060:0:5861:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787579287.243621:0:7651:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1787579287.243669:0:7651:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1787579287.243735:0:7651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1787579287.244093:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1787579287.244141:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1787579287.244267:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1787579287.244281:0:5861:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787579287.244284:0:5861:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787579287.244602:0:7652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1787579287.244814:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1787579287.244851:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1787579287.244914:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1787579287.244985:0:5861:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787579287.244988:0:5861:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787579287.245642:0:7653:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1787579287.245719:0:7653:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1787579287.245753:0:7653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1787579287.246071:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1787579287.246108:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1787579287.246171:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1787579287.246258:0:5861:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787579287.246261:0:5861:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787579287.246650:0:7654:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1787579287.246704:0:7654:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1787579287.246772:0:7654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1787579287.247101:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1787579287.247140:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1787579287.247176:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1787579287.247258:0:5861:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1787579287.247261:0:5861:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1787579287.247269:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787579287.247287:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0ceb3f79000/0xb72beeaffa1b6c18 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.247304:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ce8152e600/0xb72beeaffa1b6b69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6b62 expref: 16 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.247313:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ce8148b800/0xb72beeaffa1b6b93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6b8c expref: 16 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.247319:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ce813fc000/0xb72beeaffa1b6bbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6bb6 expref: 16 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.247326:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ce8148a200/0xb72beeaffa1b6bd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6bd2 expref: 16 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.247333:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ceb3f78000/0xb72beeaffa1b6bfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6bf5 expref: 16 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.247339:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0ceb3f79000/0xb72beeaffa1b6c18 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.247380:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ceb3f78000/0xb72beeaffa1b6bfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b6bf5 expref: 16 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.247395:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0ceb3f78000/0xb72beeaffa1b6bfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b6bf5 expref: 16 pid: 5859 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579287.247408:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ec700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5861:1874412616823424:0@lo:104: 00000100:00100000:0.0:1787579287.247465:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787579287.247509:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ce8148a200/0xb72beeaffa1b6bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b6bd2 expref: 16 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.247517:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0ce8148a200/0xb72beeaffa1b6bd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b6bd2 expref: 16 pid: 5860 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579287.247525:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830eed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5861:1874412616823552:0@lo:104: 00010000:00010000:0.0:1787579287.247547:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ce813fc000/0xb72beeaffa1b6bbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b6bb6 expref: 16 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.247554:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0ce813fc000/0xb72beeaffa1b6bbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b6bb6 expref: 16 pid: 5860 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579287.247562:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830edc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5861:1874412616823680:0@lo:104: 00010000:00010000:0.0:1787579287.247585:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ce8148b800/0xb72beeaffa1b6b93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b6b8c expref: 16 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.247593:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0ce8148b800/0xb72beeaffa1b6b93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b6b8c expref: 16 pid: 5859 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579287.247601:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ee300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5861:1874412616823808:0@lo:104: 00010000:00010000:0.0:1787579287.247631:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ce8152e600/0xb72beeaffa1b6b69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b6b62 expref: 16 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.247640:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0ce8152e600/0xb72beeaffa1b6b69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b6b62 expref: 16 pid: 5861 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579287.247648:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ef100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5861:1874412616823936:0@lo:104: 00000100:00100000:0.0:1787579287.247664:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cec16a6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787579287.249129:0:5848:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787579287.249170:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579287.249215:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579287.249226:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579287.249238:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579287.249252:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616823424 00000100:00100000:1.0:1787579287.249261:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616823424 00000100:00100000:0.0:1787579287.249290:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616823552 00000100:00100000:0.0:1787579287.249296:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616823552 00000100:00100000:1.0:1787579287.249304:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616823680 00000100:00100000:1.0:1787579287.249311:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616823680 00000100:00100000:0.0:1787579287.249318:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616823808 00000100:00100000:0.0:1787579287.249322:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616823808 00000100:00100000:1.0:1787579287.249339:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616823936 00000100:00100000:1.0:1787579287.249344:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616823936 00000100:00100000:0.0:1787579287.249347:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787579287.249359:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cea05a4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+7:5861:x1874412616823424:12345-0@lo:104: 00010000:00010000:0.0:1787579287.249372:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ce80031400/0xb72beeaffa1b6bf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6bfc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.249492:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787579287.249499:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cea05a4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+7:5861:x1874412616823424:12345-0@lo:104: Request processed in 143us (2033us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579287.249506:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787579287.249558:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787579287.249565:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+6:5861:x1874412616823552:12345-0@lo:104: 00010000:00010000:0.0:1787579287.249573:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc400/0xb72beeaffa1b6bd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6bd9 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579287.249648:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ec700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5861:1874412616823424:0@lo:104: 00000100:00100000:1.0:1787579287.249658:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830eed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5861:1874412616823552:0@lo:104: 00010000:00010000:2.0:1787579287.252775:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787579287.252789:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce80031400/0xb72beeaffa1b6bf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6bfc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579287.252800:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce80031400 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:2.0:1787579287.252835:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce80031400/0xb72beeaffa1b6bf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b6bfc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579287.252846:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce80031400/0xb72beeaffa1b6bf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b6bfc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787579287.252854:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce80031400/0xb72beeaffa1b6bf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b6bfc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579287.252861:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787579287.252914:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ce80031400/0xb72beeaffa1b6bf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6bfc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579287.252921:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787579287.252958:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce80031400/0xb72beeaffa1b6bf5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6bfc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579287.252965:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce80031400/0xb72beeaffa1b6bf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6bfc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579287.252982:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787579287.252986:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc400/0xb72beeaffa1b6bd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6bd9 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579287.252992:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce813fc400 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:2.0:1787579287.252996:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc400/0xb72beeaffa1b6bd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b6bd9 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579287.253004:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc400/0xb72beeaffa1b6bd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b6bd9 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579287.253022:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616824064:0@lo:103: 10000000:00010000:2.0:1787579287.253024:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc400/0xb72beeaffa1b6bd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b6bd9 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579287.253033:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787579287.253051:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc400/0xb72beeaffa1b6bd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6bd9 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579287.253058:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787579287.253078:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc400/0xb72beeaffa1b6bd2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6bd9 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579287.253085:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc400/0xb72beeaffa1b6bd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6bd9 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579287.253092:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787579287.253104:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579287.253106:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579287.253108:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787579287.253167:0:5863:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787579287.253171:0:5863:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1787579287.253174:0:5863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787579287.253206:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6c1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579287.253215:0:5863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6c1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579287.253224:0:5863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6c1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579287.253239:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616824320:0@lo:101: 00000100:00100000:3.0:1787579287.253271:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579287.253298:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce98663900 going to sleep for 11 seconds 00000100:00100000:3.0:1787579287.253321:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787579287.253336:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616824192:0@lo:103: 00000100:00100000:3.0:1787579287.253368:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579287.253490:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616824064 00000100:00100000:2.0:1787579287.253497:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616824064 00010000:00010000:2.0:1787579287.253533:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ceb3f78000/0xb72beeaffa1b6bfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6bf5 expref: 17 pid: 5859 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579287.253560:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616824192 00000100:00100000:2.0:1787579287.253563:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616824192 00010000:00010000:2.0:1787579287.253573:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ce8148a200/0xb72beeaffa1b6bd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6bd2 expref: 18 pid: 5860 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579287.253588:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787579287.253595:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:3322:x1874412616824064:12345-0@lo:103: 00010000:00010000:2.0:1787579287.253606:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579287.253616:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ceb3f78000/0xb72beeaffa1b6bfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6bf5 expref: 18 pid: 5859 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579287.253627:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ceb3f78000/0xb72beeaffa1b6bfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b6bf5 expref: 18 pid: 5859 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579287.253640:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ceb3f78000/0xb72beeaffa1b6bfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b6bf5 expref: 18 pid: 5859 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579287.253653:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579287.253697:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:3322:x1874412616824064:12345-0@lo:103: Request processed in 102us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579287.253704:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787579287.253718:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787579287.253724:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:3320:x1874412616824192:12345-0@lo:103: 00010000:00010000:2.0:1787579287.253732:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579287.253736:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ce8148a200/0xb72beeaffa1b6bd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6bd2 expref: 16 pid: 5860 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579287.253745:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ce8148a200/0xb72beeaffa1b6bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b6bd2 expref: 16 pid: 5860 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579287.253754:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce8148a200/0xb72beeaffa1b6bd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b6bd2 expref: 16 pid: 5860 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579287.253763:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579287.253784:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:3320:x1874412616824192:12345-0@lo:103: Request processed in 60us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579287.253790:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787579287.253858:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616824192:0@lo:103: 00010000:00010000:0.0:1787579287.253942:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1787579287.253952:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+6:5861:x1874412616823552:12345-0@lo:104: Request processed in 4386us (4782us total) trans 0 rc 0/0 00010000:00010000:3.0:1787579287.253954:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579287.253973:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787579287.254007:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616824320 00000100:00100000:1.0:1787579287.254012:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616824320 00000100:00100000:1.0:1787579287.254046:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787579287.254055:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8574b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:5863:x1874412616824320:12345-0@lo:101: 00010000:00010000:1.0:1787579287.254065:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579287.254075:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce8148b000/0xb72beeaffa1b6c26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6c1f expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579287.254076:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787579287.254088:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+5:5861:x1874412616823680:12345-0@lo:104: 00010000:00010000:1.0:1787579287.254100:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ceb3f79000/0xb72beeaffa1b6c18 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.254101:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ce80031c00/0xb72beeaffa1b6bb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6bbd expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.254119:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0ce8148b000/0xb72beeaffa1b6c26 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6c1f expref: 16 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.254134:0:5859:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffffa0ceb3f79000/0xb72beeaffa1b6c18 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.254145:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce8148b000/0xb72beeaffa1b6c26 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6c1f expref: 16 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.254152:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8148b000, rc 0) 00000100:00100000:1.0:1787579287.254195:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8574b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:5863:x1874412616824320:12345-0@lo:101: Request processed in 131us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579287.254203:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:0.0:1787579287.254257:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787579287.254264:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+5:5861:x1874412616823680:12345-0@lo:104: Request processed in 180us (5048us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579287.254271:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1787579287.254285:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787579287.254289:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce80031c00/0xb72beeaffa1b6bb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6bbd expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.254296:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce80031c00 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:0.0:1787579287.254300:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce80031c00/0xb72beeaffa1b6bb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b6bbd expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.254307:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce80031c00/0xb72beeaffa1b6bb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b6bbd expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787579287.254315:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce80031c00/0xb72beeaffa1b6bb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b6bbd expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579287.254320:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787579287.254335:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616824064:0@lo:103: 00010000:00010000:0.0:1787579287.254338:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ce80031c00/0xb72beeaffa1b6bb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6bbd expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.254345:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787579287.254376:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce80031c00/0xb72beeaffa1b6bb6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6bbd expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.254384:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce80031c00/0xb72beeaffa1b6bb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6bbd expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579287.254389:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616824448:0@lo:103: 00010000:00010000:0.0:1787579287.254396:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579287.254401:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579287.254403:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579287.254416:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787579287.254422:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579287.254427:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+4:5861:x1874412616823808:12345-0@lo:104: 00010000:00010000:0.0:1787579287.254436:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ce813fda00/0xb72beeaffa1b6b8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6b93 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579287.254461:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616824448 00000100:00100000:3.0:1787579287.254466:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616824448 00010000:00010000:0.0:1787579287.254476:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787579287.254482:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+4:5861:x1874412616823808:12345-0@lo:104: Request processed in 58us (5255us total) trans 0 rc 0/0 00010000:00010000:3.0:1787579287.254484:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ce813fc000/0xb72beeaffa1b6bbd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6bb6 expref: 16 pid: 5860 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579287.254495:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1787579287.254511:0:5853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787579287.254515:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce813fda00/0xb72beeaffa1b6b8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6b93 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.254522:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce813fda00 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:0.0:1787579287.254526:0:5853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce813fda00/0xb72beeaffa1b6b8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b6b93 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579287.254527:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1787579287.254538:0:5853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce813fda00/0xb72beeaffa1b6b8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b6b93 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579287.254539:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:3320:x1874412616824448:12345-0@lo:103: 00010000:00010000:3.0:1787579287.254552:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:00010000:0.0:1787579287.254552:0:5853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce813fda00/0xb72beeaffa1b6b8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b6b93 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579287.254558:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ce813fc000/0xb72beeaffa1b6bbd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6bb6 expref: 16 pid: 5860 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579287.254574:0:5853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787579287.254580:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ce813fc000/0xb72beeaffa1b6bbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b6bb6 expref: 16 pid: 5860 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.254592:0:5853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ce813fda00/0xb72beeaffa1b6b8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6b93 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579287.254593:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787579287.254601:0:5853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787579287.254615:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce813fda00/0xb72beeaffa1b6b8c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6b93 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.254623:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce813fda00/0xb72beeaffa1b6b8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6b93 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579287.254625:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:3320:x1874412616824448:12345-0@lo:103: Request processed in 88us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579287.254638:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1787579287.254641:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579287.254644:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579287.254647:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579287.254657:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616824576:0@lo:103: 00000100:00100000:3.0:1787579287.254669:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616824448:0@lo:103: 00000100:00100000:0.0:1787579287.254709:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579287.254747:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787579287.254755:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+3:5861:x1874412616823936:12345-0@lo:104: 00010000:00010000:0.0:1787579287.254763:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6b62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6b69 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579287.254815:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616824320:0@lo:101: 00010000:00010000:2.0:1787579287.254833:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6c1f lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6c26 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.254841:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1787579287.254842:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6c1f lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6c26 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579287.254851:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+3:5861:x1874412616823936:12345-0@lo:104: Request processed in 96us (5610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579287.254860:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787579287.254891:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce813fc000/0xb72beeaffa1b6bbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b6bb6 expref: 15 pid: 5860 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.254892:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787579287.254899:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6b62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6b69 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.254912:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148a000 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:1.0:1787579287.254918:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6b62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b6b69 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579287.254946:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830edc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5861:1874412616823680:0@lo:104: 00010000:00010000:1.0:1787579287.254957:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6b62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b6b69 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579287.254960:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ee300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5861:1874412616823808:0@lo:104: 00000100:00100000:0.0:1787579287.254972:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ef100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5861:1874412616823936:0@lo:104: 10000000:00010000:1.0:1787579287.254983:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6b62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b6b69 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579287.254988:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787579287.255005:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6b62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6b69 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.255011:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787579287.255027:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6b62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6b69 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.255035:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6b62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6b69 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.255050:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579287.255052:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579287.255056:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579287.255065:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0ceb3f79000/0xb72beeaffa1b6c18 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579287.255081:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616824704:0@lo:103: 00000100:00100000:0.0:1787579287.255105:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579287.255255:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616824576 00000100:00100000:1.0:1787579287.255259:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616824576 00010000:00010000:1.0:1787579287.255275:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ce8148b800/0xb72beeaffa1b6b93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6b8c expref: 15 pid: 5859 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579287.255301:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616824704 00000100:00100000:1.0:1787579287.255304:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616824704 00010000:00010000:1.0:1787579287.255314:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ce8152e600/0xb72beeaffa1b6b69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6b62 expref: 16 pid: 5861 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579287.255325:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787579287.255331:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:3321:x1874412616824576:12345-0@lo:103: 00010000:00010000:1.0:1787579287.255338:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787579287.255350:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ce8148b800/0xb72beeaffa1b6b93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6b8c expref: 16 pid: 5859 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.255359:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ce8148b800/0xb72beeaffa1b6b93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b6b8c expref: 16 pid: 5859 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.255370:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce8148b800/0xb72beeaffa1b6b93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b6b8c expref: 16 pid: 5859 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.255380:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787579287.255415:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:3321:x1874412616824576:12345-0@lo:103: Request processed in 84us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579287.255422:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787579287.255435:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787579287.255441:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:3322:x1874412616824704:12345-0@lo:103: 00010000:00010000:1.0:1787579287.255449:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787579287.255453:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ce8152e600/0xb72beeaffa1b6b69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6b62 expref: 14 pid: 5861 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.255462:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ce8152e600/0xb72beeaffa1b6b69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b6b62 expref: 14 pid: 5861 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.255471:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce8152e600/0xb72beeaffa1b6b69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b6b62 expref: 14 pid: 5861 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.255482:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0ceb3f79000/0xb72beeaffa1b6c18 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.255489:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceb3f79000/0xb72beeaffa1b6c18 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.255522:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0ceb3f79000/0xb72beeaffa1b6c18 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.255530:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0ceb3f79000/0xb72beeaffa1b6c18 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.255537:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0ceb3f79000/0xb72beeaffa1b6c18 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.255544:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0ceb3f79000/0xb72beeaffa1b6c18 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.255549:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb3f79000 already unused, calling callback (ffffffffc1654230) 00010000:00010000:1.0:1787579287.255552:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0ceb3f79000/0xb72beeaffa1b6c18 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.255559:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0ceb3f79000/0xb72beeaffa1b6c18 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.255572:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0ce8148b000/0xb72beeaffa1b6c26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0xb72beeaffa1b6c1f expref: 13 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.255579:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce8148b000/0xb72beeaffa1b6c26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0xb72beeaffa1b6c1f expref: 13 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.255598:0:5850:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffffa0ce8148b000/0xb72beeaffa1b6c26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6c1f expref: 13 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579287.255608:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:MGS:5850:1874412616824832:0@lo:105: 00000100:00100000:1.0:1787579287.255630:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579287.255653:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce87c6f840 going to sleep for 11 seconds 00000100:00100000:1.0:1787579287.255668:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616824832 00000100:00100000:1.0:1787579287.255787:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616824832 00000100:00100000:1.0:1787579287.255812:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787579287.255817:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+3:5850:x1874412616824832:12345-0@lo:105: 00010000:00010000:1.0:1787579287.255825:0:5848:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6c1f lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6c26 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.255833:0:5848:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6c1f lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6c26 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.255840:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6c1f lrc: 5/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0xb72beeaffa1b6c26 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.255846:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6c1f lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0xb72beeaffa1b6c26 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.255852:0:5848:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6c1f lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1080000000000 nid: local remote: 0xb72beeaffa1b6c26 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.255870:0:5848:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffffa0ce8152e200) 00000100:00100000:1.0:1787579287.255897:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+3:5850:x1874412616824832:12345-0@lo:105: Request processed in 79us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579287.255904:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1787579287.255919:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6c1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6c26 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.255952:0:5863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6c1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6c26 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579287.256015:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616824960:0@lo:501: 00000100:00100000:1.0:1787579287.256041:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579287.256060:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce97446840 going to sleep for 11 seconds 00000100:00100000:1.0:1787579287.256073:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616824960 00000100:00100000:1.0:1787579287.256076:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616824960 00000100:00100000:1.0:1787579287.256094:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787579287.256099:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce85748c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:5863:x1874412616824960:12345-0@lo:501: 00000100:00100000:0.0:1787579287.256448:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616824576:0@lo:103: 00010000:00010000:0.0:1787579287.256470:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0ceb3f79000/0xb72beeaffa1b6c18 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.256478:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0ceb3f79000/0xb72beeaffa1b6c18 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787579287.256485:0:5861:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787579287.257210:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:MGS:5850:1874412616824832:0@lo:105: 00010000:00010000:0.0:1787579287.257226:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0ceb3f79000/0xb72beeaffa1b6c18 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.257234:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ceb3f79000/0xb72beeaffa1b6c18 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.257244:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579287.257282:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:3322:x1874412616824704:12345-0@lo:103: Request processed in 1841us (2176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579287.257301:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787579287.257329:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616824704:0@lo:103: 00000100:00100000:1.0:1787579287.257526:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce85748c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:5863:x1874412616824960:12345-0@lo:501: Request processed in 1425us (1482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579287.257532:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787579287.257562:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616824960:0@lo:501: 00000100:00100000:1.0:1787579287.257594:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616825088:0@lo:503: 00000100:00100000:1.0:1787579287.257632:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579287.257699:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce97446840 going to sleep for 11 seconds 00000100:00100000:1.0:1787579287.257731:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616825088 00000100:00100000:1.0:1787579287.257737:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616825088 00000100:00100000:0.0:1787579287.257923:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787579287.257955:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce85749450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:5863:x1874412616825088:12345-0@lo:503: 00000100:00100000:0.0:1787579287.258103:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce85749450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:5863:x1874412616825088:12345-0@lo:503: Request processed in 150us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579287.258110:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787579287.258197:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616825088:0@lo:503: 00000100:00100000:2.0:1787579287.258476:0:7655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7655:1874412616825216:0@lo:502: 00000100:00100000:2.0:1787579287.258522:0:7655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579287.258540:0:7655:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cec15959c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787579287.258578:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616825216 00000100:00100000:0.0:1787579287.258583:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616825216 00000100:00100000:0.0:1787579287.258600:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787579287.258605:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8574bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:7655:x1874412616825216:12345-0@lo:502: 00000100:00100000:0.0:1787579287.258773:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8574bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:7655:x1874412616825216:12345-0@lo:502: Request processed in 166us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579287.258789:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787579287.258829:0:7655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7655:1874412616825216:0@lo:502: 00000020:01000000:2.0:1787579287.258851:0:7655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787579287.258859:0:7655:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787579287.258865:0:7655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787579287.258868:0:7655:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787579287.258874:0:7655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787579287.258877:0:7655:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.153@tcp to nid 0x20000c0a8ce99 (192.168.206.153@tcp) 00000020:01000000:2.0:1787579287.258950:0:7655:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787579287.258954:0:7655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787579287.258973:0:7655:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffffa0ceb3d58000) 00000020:00000080:2.0:1787579287.259054:0:7655:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1787579287.259061:0:7655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787579287.259123:0:7655:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787579287.259128:0:7655:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787579287.259134:0:7655:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb72beeaffa1b6c34 00010000:00080000:2.0:1787579287.259159:0:7655:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0ceb3d49800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.153@tcp at head 00010000:00010000:2.0:1787579287.259365:0:7655:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-4 is initialized 00000040:01000000:2.0:1787579287.259650:0:7655:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787579287.259666:0:7655:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787579287.260155:0:7655:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787579287.260377:0:7655:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787579287.260438:0:7655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787579287.260509:0:7655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787579287.270895:0:7656:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787579287.270902:0:7656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787579287.271657:0:7655:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787579287.271670:0:7655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787579287.271746:0:7655:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787579287.271765:0:7655:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb72beeaffa1b6c3b 00000100:00080000:2.0:1787579287.271774:0:7655:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787579287.271781:0:7655:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0ceb3d49800 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:2.0:1787579287.271813:0:7655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0cec119e300 x1874412616825344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787579287.271865:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616825344:0@lo:8: 00000100:00080000:2.0:1787579287.271916:0:7655:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1787579287.271969:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1787579287.271996:0:7655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787579287.272002:0:7655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787579287.272004:0:7655:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787579287.272009:0:7655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787579287.272013:0:7655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787579287.272015:0:7655:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787579287.272019:0:7655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787579287.272021:0:7655:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787579287.272046:0:7655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7655:1874412616825472:0@lo:502: 00000100:00100000:3.0:1787579287.272085:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616825344 00000100:00100000:2.0:1787579287.272095:0:7655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579287.272098:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616825344 00000100:00100000:2.0:1787579287.272123:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616825472 00000100:00100000:2.0:1787579287.272129:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616825472 00000100:00100000:2.0:1787579287.272159:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787579287.272167:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91ddac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:7655:x1874412616825472:12345-0@lo:502: 00000100:00100000:0.0:1787579287.272331:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1874412616825728:0@lo:400: 00000100:00100000:0.0:1787579287.272367:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579287.272391:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91ddac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:7655:x1874412616825472:12345-0@lo:502: Request processed in 223us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579287.272397:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787579287.272407:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874412616825600:0@lo:400: 00000100:00100000:2.0:1787579287.272412:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787579287.272436:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579287.272464:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616825856:0@lo:400: 00000100:00100000:0.0:1787579287.272486:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579287.272524:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616825728 00000100:00100000:0.0:1787579287.272528:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616825728 00000100:00100000:3.0:1787579287.272560:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616825856 00000100:00100000:3.0:1787579287.272565:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616825856 00000100:00100000:0.0:1787579287.272566:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616825600 00000100:00100000:0.0:1787579287.272571:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616825600 00000100:00100000:0.0:1787579287.272602:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787579287.272603:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787579287.272612:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874412616825728:12345-0@lo:400: 00000100:00100000:3.0:1787579287.272617:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616825856:12345-0@lo:400: 00000100:00100000:2.0:1787579287.272628:0:7655:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce92d47000 going to sleep for 11 seconds 00000100:00100000:2.0:1787579287.272651:0:7655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7655:1874412616825472:0@lo:502: 00000020:01000000:2.0:1787579287.272687:0:7655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:1.0:1787579287.272689:0:6710:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000020:00000080:2.0:1787579287.272692:0:7655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787579287.272696:0:7655:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000100:00100000:1.0:1787579287.272698:0:6710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000040:00080000:2.0:1787579287.272701:0:7655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1787579287.272801:0:5863:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1787579287.272822:0:5863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787579287.272831:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6c1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6c26 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.272842:0:5863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6c1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6c26 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579287.272858:0:5863:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787579287.272861:0:5863:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa0ce98720000 from 1 10000000:01000000:1.0:1787579287.272864:0:5863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787579287.272884:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b800/0xb72beeaffa1b6c42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.272892:0:5863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b800/0xb72beeaffa1b6c42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579287.272901:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787579287.272904:0:5863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b800/0xb72beeaffa1b6c42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579287.272910:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3318:x1874412616825344:12345-0@lo:8: 00000100:00100000:1.0:1787579287.272923:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616825984:0@lo:101: 00010000:00020000:2.0:1787579287.272946:0:6710:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787579287.273750:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874412616825728:12345-0@lo:400: Request processed in 1137us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579287.273772:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787579287.273777:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616825856:12345-0@lo:400: Request processed in 1155us (1279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579287.273796:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787579287.273801:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787579287.273806:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874412616825600:12345-0@lo:400: 00000100:00100000:1.0:1787579287.273874:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579287.273884:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874412616825600:12345-0@lo:400: Request processed in 78us (1446us total) trans 0 rc 0/0 00010000:00080000:3.0:1787579287.273894:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ce830edc00 x1874412616825856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579287.273895:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787579287.273897:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3318:x1874412616825344:12345-0@lo:8: Request processed in 985us (1927us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787579287.273909:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787579287.273954:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787579287.273962:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787579287.273968:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616825984 00000100:00100000:3.0:1787579287.273975:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616825856:0@lo:400: 00000100:00100000:1.0:1787579287.273976:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce85218a80 going to sleep for 11 seconds 00010000:00080000:0.0:1787579287.274000:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ce830edf80 x1874412616825600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579287.274011:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874412616825600:0@lo:400: 00010000:00080000:0.0:1787579287.274026:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ce830ee300 x1874412616825728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579287.274034:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1874412616825728:0@lo:400: 00000100:00100000:2.0:1787579287.275209:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616825984 00000100:00100000:2.0:1787579287.275256:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787579287.275265:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:5863:x1874412616825984:12345-0@lo:101: 00010000:00010000:2.0:1787579287.275276:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579287.275290:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6c49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6c42 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579287.275313:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6c49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6c42 expref: 14 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579287.275324:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6c49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6c42 expref: 14 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579287.275332:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce813fc400, rc 0) 00000100:00100000:2.0:1787579287.275385:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:5863:x1874412616825984:12345-0@lo:101: Request processed in 121us (1514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579287.275392:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1787579287.275462:0:3318:0:(import.c:65:import_set_state_nolock()) ffffa0ceb3d49800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787579287.275468:0:3318:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787579287.275472:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616825344:0@lo:8: 00000100:00100000:2.0:1787579287.275504:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616825984:0@lo:101: 00010000:00010000:2.0:1787579287.275517:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b800/0xb72beeaffa1b6c42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6c49 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579287.275527:0:5863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b800/0xb72beeaffa1b6c42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6c49 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579287.275582:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616826112:0@lo:501: 00000100:00100000:2.0:1787579287.275613:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579287.275637:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce92d47e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787579287.276076:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616826112 00000100:00100000:3.0:1787579287.276081:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616826112 00000100:00100000:3.0:1787579287.276106:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787579287.276122:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:5863:x1874412616826112:12345-0@lo:501: 00000100:00100000:2.0:1787579287.276404:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616826112:0@lo:501: 10000000:01000000:2.0:1787579287.276430:0:5863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787579287.276437:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b800/0xb72beeaffa1b6c42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6c49 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579287.276447:0:5863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b800/0xb72beeaffa1b6c42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6c49 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579287.276639:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:5863:x1874412616826112:12345-0@lo:501: Request processed in 525us (1023us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787579287.276646:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787579287.333215:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce85748450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:7649:x1874412616823296:12345-0@lo:253: Request processed in 93294us (93606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579287.333228:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787579287.333409:0:7649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616823296:0@lo:253: 10000000:01000000:1.0:1787579287.333423:0:7649:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787579287.333427:0:7649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787579287.333428:0:7649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787579287.333430:0:7649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787579287.333431:0:7649:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1787579287.333432:0:7649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787579287.333433:0:7649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787579287.333435:0:7649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787579287.333437:0:7649:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787579287.333438:0:7649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787579287.333450:0:7649:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787579287.333472:0:7649:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0ceb3138000 from lustre-OST0001 10000000:01000000:1.0:1787579287.333494:0:7649:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787579287.333497:0:7649:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787579287.333504:0:7649:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa0ce98720000 local copy 00010000:00010000:1.0:1787579287.333528:0:7649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b800/0xb72beeaffa1b6c42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6c49 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579287.333623:0:7649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616826240:0@lo:501: 00000100:00100000:1.0:1787579287.333658:0:7649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579287.333798:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616826240 00000100:00100000:2.0:1787579287.333804:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616826240 00000100:00100000:2.0:1787579287.333836:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787579287.333853:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:7649:x1874412616826240:12345-0@lo:501: 00000100:00100000:2.0:1787579287.334062:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:7649:x1874412616826240:12345-0@lo:501: Request processed in 210us (403us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787579287.334070:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787579287.334268:0:7649:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce85218180 going to sleep for 11 seconds 00000100:00100000:1.0:1787579287.334283:0:7649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616826240:0@lo:501: 10000000:01000000:1.0:1787579287.334296:0:7649:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787579287.334323:0:7649:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787579287.334329:0:7649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b800/0xb72beeaffa1b6c42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6c49 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.334338:0:7649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b800/0xb72beeaffa1b6c42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6c49 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579287.334356:0:7649:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0ceb3138000 10000000:01000000:1.0:1787579287.334360:0:7649:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787579287.334365:0:7649:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787579287.334368:0:7649:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787579287.334372:0:7649:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787579287.334375:0:7649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787579287.334395:0:7649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6c50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.334402:0:7649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6c50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.334411:0:7649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6c50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579287.334434:0:7649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616826368:0@lo:101: 00000100:00100000:1.0:1787579287.334474:0:7649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579287.334536:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616826368 00000100:00100000:0.0:1787579287.334540:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616826368 00000100:00100000:0.0:1787579287.334572:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787579287.334580:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:7649:x1874412616826368:12345-0@lo:101: 00010000:00010000:0.0:1787579287.334588:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579287.334606:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceb3f79000/0xb72beeaffa1b6c57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6c50 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.334625:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceb3f79000/0xb72beeaffa1b6c57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6c50 expref: 14 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.334636:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceb3f79000/0xb72beeaffa1b6c57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6c50 expref: 14 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.334644:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb3f79000, rc 0) 00000100:00100000:0.0:1787579287.334670:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:7649:x1874412616826368:12345-0@lo:101: Request processed in 91us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579287.334687:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787579287.338726:0:7649:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce85218180 going to sleep for 11 seconds 00000100:00100000:1.0:1787579287.338767:0:7649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616826368:0@lo:101: 00010000:00010000:1.0:1787579287.338831:0:7649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6c50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6c57 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.338844:0:7649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6c50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6c57 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579287.338989:0:7649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616826496:0@lo:501: 00000100:00100000:1.0:1787579287.339042:0:7649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579287.339137:0:7649:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce85218180 going to sleep for 11 seconds 00000100:00100000:0.0:1787579287.341918:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616826496 00000100:00100000:0.0:1787579287.341944:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616826496 00000100:00100000:0.0:1787579287.342060:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787579287.342072:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91ddb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:7649:x1874412616826496:12345-0@lo:501: 00000100:00100000:0.0:1787579287.343536:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91ddb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:7649:x1874412616826496:12345-0@lo:501: Request processed in 1464us (4490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579287.343547:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787579287.343644:0:7649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616826496:0@lo:501: 00000100:00100000:1.0:1787579287.343701:0:7649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616826624:0@lo:503: 00000100:00100000:1.0:1787579287.343744:0:7649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579287.350919:0:7649:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce85218180 going to sleep for 11 seconds 00000100:00100000:2.0:1787579287.351028:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616826624 00000100:00100000:2.0:1787579287.351036:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616826624 00000100:00100000:2.0:1787579287.351086:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787579287.351096:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:7649:x1874412616826624:12345-0@lo:503: 00000100:00100000:2.0:1787579287.351323:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:7649:x1874412616826624:12345-0@lo:503: Request processed in 227us (7576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579287.351330:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787579287.351431:0:7649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616826624:0@lo:503: 00000040:00080000:1.0:1787579287.351738:0:7649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787579287.351802:0:7649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616826752:0@lo:502: 00000100:00100000:1.0:1787579287.351840:0:7649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579287.351868:0:7649:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce85218180 going to sleep for 11 seconds 00000100:00100000:2.0:1787579287.352042:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616826752 00000100:00100000:2.0:1787579287.352047:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616826752 00000100:00100000:2.0:1787579287.352075:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787579287.352082:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:7649:x1874412616826752:12345-0@lo:502: 00000100:00100000:2.0:1787579287.352247:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:7649:x1874412616826752:12345-0@lo:502: Request processed in 164us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579287.352253:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787579287.352352:0:7649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616826752:0@lo:502: 00000040:00080000:1.0:1787579287.352653:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787579287.352723:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787579287.352758:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787579287.352816:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787579287.352856:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787579287.352909:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787579287.352969:0:7649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616826880:0@lo:502: 00000100:00100000:1.0:1787579287.353008:0:7649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579287.353041:0:7649:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce85218180 going to sleep for 11 seconds 00000100:00100000:3.0:1787579287.353260:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616826880 00000100:00100000:3.0:1787579287.353265:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616826880 00000100:00100000:3.0:1787579287.353298:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787579287.353305:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:7649:x1874412616826880:12345-0@lo:502: 00000100:00100000:3.0:1787579287.353501:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:7649:x1874412616826880:12345-0@lo:502: Request processed in 137us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579287.353509:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787579287.353619:0:7649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616826880:0@lo:502: 00000040:00080000:1.0:1787579287.353705:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787579287.353715:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1787579287.354282:0:7661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787579287.354289:0:7661:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787579287.354296:0:7661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579287.354298:0:7661:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787579287.354303:0:7661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787579287.354315:0:7661:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffffa0ce8674b370) 00000020:00000080:1.0:1787579287.354344:0:7661:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787579287.354352:0:7661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787579287.354432:0:7661:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0ceb3138000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787579287.354440:0:7661:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787579287.354724:0:7661:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb72beeaffa1b6c65 00010000:00010000:1.0:1787579287.359437:0:7661:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1787579287.359800:0:7661:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1787579287.362331:0:7661:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787579287.362606:0:7661:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1787579287.366617:0:7661:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1787579287.367185:0:7661:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787579287.368392:0:7661:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787579287.368402:0:7661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787579287.368413:0:7661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579287.368415:0:7661:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787579287.368420:0:7661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787579287.368423:0:7661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579287.368424:0:7661:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787579287.368427:0:7661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787579287.368429:0:7661:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787579287.368483:0:7661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787579287.368486:0:7661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579287.368488:0:7661:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787579287.368491:0:7661:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787579287.368724:0:7649:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1787579287.368747:0:7649:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787579287.368769:0:7649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6c50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6c57 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.368790:0:7649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6c57 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579287.368798:0:7649:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0ceb3138000 from 1 10000000:01000000:1.0:1787579287.368801:0:7649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787579287.368830:0:7649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6c6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.368837:0:7649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6c6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.368847:0:7649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6c6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579287.368866:0:7649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616827008:0@lo:101: 00000100:00100000:1.0:1787579287.368923:0:7649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579287.368977:0:7649:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb1c51000 going to sleep for 11 seconds 00000100:00100000:1.0:1787579287.368997:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616827008 00000100:00100000:1.0:1787579287.369004:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616827008 00000100:00100000:1.0:1787579287.369038:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787579287.369045:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91ddb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:7649:x1874412616827008:12345-0@lo:101: 00010000:00010000:1.0:1787579287.369058:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579287.369069:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce8148ac00/0xb72beeaffa1b6c73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6c6c expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.369090:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce8148ac00/0xb72beeaffa1b6c73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6c6c expref: 15 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.369100:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce8148ac00/0xb72beeaffa1b6c73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6c6c expref: 15 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.369124:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8148ac00, rc 0) 00000100:00100000:1.0:1787579287.369163:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91ddb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:7649:x1874412616827008:12345-0@lo:101: Request processed in 117us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579287.369170:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787579287.369214:0:7649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616827008:0@lo:101: 00010000:00010000:1.0:1787579287.369227:0:7649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6c6c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6c73 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.369236:0:7649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6c6c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6c73 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579287.369308:0:7649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616827136:0@lo:501: 00000100:00100000:1.0:1787579287.369332:0:7649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579287.369345:0:7649:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb1c51000 going to sleep for 11 seconds 00000100:00100000:1.0:1787579287.369359:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616827136 00000100:00100000:1.0:1787579287.369362:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616827136 00000100:00100000:1.0:1787579287.369382:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787579287.369387:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:7649:x1874412616827136:12345-0@lo:501: 00000100:00100000:1.0:1787579287.369640:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:7649:x1874412616827136:12345-0@lo:501: Request processed in 251us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579287.369647:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787579287.369695:0:7649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616827136:0@lo:501: 00000100:00100000:1.0:1787579287.369718:0:7649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616827264:0@lo:503: 00000100:00100000:1.0:1787579287.369761:0:7649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579287.369782:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616827264 00000100:00100000:1.0:1787579287.369791:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616827264 00000100:00100000:1.0:1787579287.369818:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787579287.369825:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:7649:x1874412616827264:12345-0@lo:503: 00000100:00100000:1.0:1787579287.370258:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:7649:x1874412616827264:12345-0@lo:503: Request processed in 432us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579287.370264:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787579287.370305:0:7649:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb1c51000 going to sleep for 11 seconds 00000100:00100000:1.0:1787579287.370316:0:7649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616827264:0@lo:503: 00000040:00080000:1.0:1787579287.370621:0:7649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787579287.370685:0:7649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616827392:0@lo:502: 00000100:00100000:1.0:1787579287.370721:0:7649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579287.370754:0:7649:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb59543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787579287.370807:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616827392 00000100:00100000:0.0:1787579287.370812:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616827392 00000100:00100000:0.0:1787579287.370879:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787579287.370887:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91ddbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:7649:x1874412616827392:12345-0@lo:502: 00000100:00100000:0.0:1787579287.371851:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91ddbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:7649:x1874412616827392:12345-0@lo:502: Request processed in 963us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579287.371860:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787579287.372073:0:7649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616827392:0@lo:502: 00000040:00080000:3.0:1787579287.372400:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787579287.372477:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787579287.372510:0:7649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f17800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616827520:0@lo:502: 00000100:00100000:3.0:1787579287.372561:0:7649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579287.372597:0:7649:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce98663480 going to sleep for 11 seconds 00000100:00100000:1.0:1787579287.372728:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616827520 00000100:00100000:1.0:1787579287.372735:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616827520 00000100:00100000:1.0:1787579287.372870:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787579287.372880:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91ddb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:7649:x1874412616827520:12345-0@lo:502: 00000100:00100000:1.0:1787579287.373122:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91ddb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:7649:x1874412616827520:12345-0@lo:502: Request processed in 235us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579287.373131:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787579287.373309:0:7649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f17800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616827520:0@lo:502: 00000040:00080000:3.0:1787579287.373395:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787579287.373405:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787579287.374736:0:7665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787579287.374746:0:7665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579287.374753:0:7665:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787579287.374759:0:7665:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0ceb3138000 00000020:00000080:0.0:1787579287.374762:0:7665:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787579287.374884:0:7665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787579287.374888:0:7665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579287.374890:0:7665:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787579287.374893:0:7665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787579287.375125:0:7649:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787579287.375156:0:7649:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787579287.375172:0:7649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6c6c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6c73 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579287.375184:0:7649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6c6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6c73 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579287.375220:0:7649:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787579287.375222:0:7649:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0ceb3138000 10000000:01000000:2.0:1787579287.375230:0:7649:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0ceb3138000 10000000:01000000:2.0:1787579287.375234:0:7649:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787579287.375239:0:7649:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0ceb3138000 from 1 10000000:01000000:2.0:1787579287.375242:0:7649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787579287.375268:0:7649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc800/0xb72beeaffa1b6c7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579287.375277:0:7649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc800/0xb72beeaffa1b6c7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579287.375286:0:7649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc800/0xb72beeaffa1b6c7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579287.375303:0:7649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616827648:0@lo:101: 00000100:00100000:2.0:1787579287.375348:0:7649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579287.375412:0:7649:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce92d479c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787579287.375444:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616827648 00000100:00100000:0.0:1787579287.375450:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616827648 00000100:00100000:0.0:1787579287.375511:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787579287.375519:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:7649:x1874412616827648:12345-0@lo:101: 00010000:00010000:0.0:1787579287.375530:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579287.375545:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceb3f79600/0xb72beeaffa1b6c81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6c7a expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.375564:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceb3f79600/0xb72beeaffa1b6c81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6c7a expref: 16 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.375574:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceb3f79600/0xb72beeaffa1b6c81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6c7a expref: 16 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.375583:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb3f79600, rc 0) 00000100:00100000:0.0:1787579287.375623:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:7649:x1874412616827648:12345-0@lo:101: Request processed in 106us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579287.375630:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787579287.375751:0:7649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616827648:0@lo:101: 00010000:00010000:2.0:1787579287.375764:0:7649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc800/0xb72beeaffa1b6c7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6c81 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579287.375783:0:7649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc800/0xb72beeaffa1b6c7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6c81 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579287.375866:0:7649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616827776:0@lo:501: 00000100:00100000:2.0:1787579287.375891:0:7649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579287.378217:0:7649:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce92d479c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787579287.378300:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616827776 00000100:00100000:0.0:1787579287.378307:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616827776 00000100:00100000:0.0:1787579287.378384:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787579287.378393:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:7649:x1874412616827776:12345-0@lo:501: 00000100:00100000:0.0:1787579287.378657:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:7649:x1874412616827776:12345-0@lo:501: Request processed in 265us (2764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579287.378687:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787579287.378764:0:7649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616827776:0@lo:501: 00000100:00100000:2.0:1787579287.378802:0:7649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616827904:0@lo:503: 00000100:00100000:2.0:1787579287.378846:0:7649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579287.378863:0:7649:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce92d479c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787579287.378890:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616827904 00000100:00100000:1.0:1787579287.378896:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616827904 00000100:00100000:1.0:1787579287.378999:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787579287.379007:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:7649:x1874412616827904:12345-0@lo:503: 00000100:00100000:1.0:1787579287.379158:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:7649:x1874412616827904:12345-0@lo:503: Request processed in 152us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579287.379165:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787579287.379187:0:7649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616827904:0@lo:503: 00000040:00080000:3.0:1787579287.379729:0:7649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787579287.379782:0:7649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f17800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616828032:0@lo:502: 00000100:00100000:3.0:1787579287.379823:0:7649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579287.379861:0:7649:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce98663480 going to sleep for 11 seconds 00000100:00100000:0.0:1787579287.379987:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616828032 00000100:00100000:0.0:1787579287.379992:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616828032 00000100:00100000:0.0:1787579287.380025:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787579287.380035:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:7649:x1874412616828032:12345-0@lo:502: 00000100:00100000:0.0:1787579287.380706:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:7649:x1874412616828032:12345-0@lo:502: Request processed in 672us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579287.380714:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787579287.387003:0:7649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f17800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616828032:0@lo:502: 00000040:00080000:3.0:1787579287.387331:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787579287.387828:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787579287.388032:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787579287.388109:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787579287.388149:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787579287.388204:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787579287.388307:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787579287.388339:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787579287.388470:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787579287.388509:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787579287.388545:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787579287.388588:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787579287.388710:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787579287.388825:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787579287.389083:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787579287.389123:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787579287.389158:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787579287.389203:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787579287.389306:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787579287.389338:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787579287.389440:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787579287.389475:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787579287.389508:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787579287.389553:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787579287.389653:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787579287.389708:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787579287.389832:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787579287.390452:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1787579287.390493:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787579287.390560:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1787579287.390688:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1787579287.390800:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1787579287.390838:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1787579287.391065:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1787579287.391104:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1787579287.391148:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1787579287.391193:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1787579287.391303:0:7649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f17800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616828160:0@lo:502: 00000100:00100000:3.0:1787579287.391376:0:7649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579287.391457:0:7649:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce98663480 going to sleep for 11 seconds 00000100:00100000:2.0:1787579287.391496:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616828160 00000100:00100000:2.0:1787579287.391504:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616828160 00000100:00100000:2.0:1787579287.391547:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787579287.391556:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:7649:x1874412616828160:12345-0@lo:502: 00000100:00100000:2.0:1787579287.392397:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:7649:x1874412616828160:12345-0@lo:502: Request processed in 840us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579287.392407:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787579287.392909:0:7649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f17800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616828160:0@lo:502: 00000040:00080000:2.0:1787579287.393177:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1787579287.393190:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1787579287.394109:0:7666:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787579287.394140:0:7666:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffffa0ceb44a8000) 00000020:00000080:1.0:1787579287.394162:0:7666:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1787579287.394272:0:7666:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0ceb3138000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787579287.394277:0:7666:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0ceb3138000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787579287.394280:0:7666:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0ceb3138000 3 00010000:00080000:1.0:1787579287.394313:0:7666:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0ceb44b0000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.153@tcp at head 00010000:00010000:1.0:1787579287.396490:0:7666:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1787579287.396877:0:7666:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787579287.396910:0:7666:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787579287.396921:0:7666:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xb72beeaffa1b6c8f 00000100:00080000:1.0:1787579287.396958:0:7666:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787579287.396963:0:7666:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa0ceb44b0000 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:1.0:1787579287.396994:0:7666:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ceb480e680 x1874412616828288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787579287.397019:0:7666:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1787579287.397473:0:7666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1787579287.397617:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3318:1874412616828288:0@lo:38: 00000100:00100000:2.0:1787579287.397695:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1787579287.397870:0:7649:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1787579287.397897:0:7649:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787579287.397912:0:7649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc800/0xb72beeaffa1b6c7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6c81 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579287.397946:0:7649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc800/0xb72beeaffa1b6c7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6c81 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787579287.397990:0:7649:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787579287.397992:0:7649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787579287.397994:0:7649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787579287.397995:0:7649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787579287.397997:0:7649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787579287.397998:0:7649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787579287.397999:0:7649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787579287.398001:0:7649:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787579287.398002:0:7649:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787579287.398004:0:7649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787579287.398008:0:7649:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787579287.398012:0:7649:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1787579287.398014:0:7649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787579287.398016:0:7649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787579287.398016:0:7649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787579287.398017:0:7649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787579287.398018:0:7649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787579287.398020:0:7649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787579287.398020:0:7649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787579287.398021:0:7649:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787579287.398022:0:7649:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787579287.398023:0:7649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787579287.398024:0:7649:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787579287.398050:0:7649:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787579287.398061:0:7649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616828416:0@lo:253: 00000100:00100000:2.0:1787579287.398093:0:7649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579287.398117:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616828416 00000100:00100000:2.0:1787579287.398124:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616828416 00000100:00100000:2.0:1787579287.398156:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787579287.398164:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:7649:x1874412616828416:12345-0@lo:253: 20000000:01000000:2.0:1787579287.398185:0:5860:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787579287.398197:0:5860:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787579287.398554:0:7649:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce92d47f00 going to sleep for 11 seconds 00000100:00080000:0.0:1787579287.398772:0:7667:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffffa0ce830ee300 x1874412616828544/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579287.398781:0:7667:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cec16a6900 going to sleep for 0 seconds 00000100:00100000:1.0:1787579287.398962:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616828288 00000100:00100000:1.0:1787579287.398968:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616828288 00000100:00100000:1.0:1787579287.398990:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787579287.398996:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3318:x1874412616828288:12345-0@lo:38: 00010000:00080000:1.0:1787579287.399015:0:5866:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:1.0:1787579287.399046:0:5866:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xb72beeaffa1b6c96 00000004:00100000:1.0:1787579287.399060:0:5866:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787579287.399087:0:5866:0:(import.c:65:import_set_state_nolock()) ffffa0ceb44b6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787579287.399141:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874412616828288:12345-0@lo:38: Request processed in 143us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579287.399149:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787579287.399424:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ceb480e680 x1874412616828288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787579297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579287.399441:0:3318:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787579287.399449:0:3318:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1787579287.399457:0:3318:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787579287.399462:0:3318:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787579287.399465:0:3318:0:(import.c:65:import_set_state_nolock()) ffffa0ceb44b0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1787579287.399472:0:3318:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000e386d576): req@ffffa0ce830ee300 x1874412616828544/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579287.399488:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3318:1874412616828288:0@lo:38: 00000100:00100000:1.0:1787579287.399543:0:7667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579287.399572:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616828544 00000100:00100000:1.0:1787579287.399577:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616828544 00000100:00100000:1.0:1787579287.400284:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787579287.400294:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7667:x1874412616828544:12345-0@lo:901: 00000100:00100000:1.0:1787579287.400576:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7667:x1874412616828544:12345-0@lo:901: Request processed in 284us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579287.400584:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787579287.400802:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787579287.400832:0:7667:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ce830ee300 x1874412616828544/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787579303 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579287.400855:0:7667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ee300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7667:1874412616828544:0@lo:901: 20000000:01000000:2.0:1787579287.423761:0:5860:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787579287.423776:0:5860:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787579287.423812:0:5882:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787579287.423818:0:5882:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787579287.423838:0:5882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0ceb3f78200/0xb72beeaffa1b6c9d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.423857:0:5882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ce80030c00/0xb72beeaffa1b6bcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6bc4 expref: 16 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.423867:0:5882:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0ceb3f78200/0xb72beeaffa1b6c9d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.423902:0:5882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ce80030c00/0xb72beeaffa1b6bcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b6bc4 expref: 16 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.423916:0:5882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0ce80030c00/0xb72beeaffa1b6bcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b6bc4 expref: 16 pid: 5861 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579287.423955:0:5882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830edf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5882:1874412616828672:0@lo:104: 00000100:00100000:0.0:1787579287.424085:0:5882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579287.424130:0:5882:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce983a3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787579287.424156:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616828672 00000100:00100000:1.0:1787579287.424163:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616828672 00000100:00100000:1.0:1787579287.424212:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787579287.424220:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+3:5882:x1874412616828672:12345-0@lo:104: 00010000:00010000:1.0:1787579287.424233:0:5848:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ce813fcc00/0xb72beeaffa1b6bc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6bcb expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.424285:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787579287.424291:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+3:5882:x1874412616828672:12345-0@lo:104: Request processed in 72us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579287.424298:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1787579287.424410:0:5853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787579287.424416:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce813fcc00/0xb72beeaffa1b6bc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6bcb expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.424424:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce813fcc00 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:0.0:1787579287.424427:0:5853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce813fcc00/0xb72beeaffa1b6bc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b6bcb expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.424436:0:5853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce813fcc00/0xb72beeaffa1b6bc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b6bcb expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787579287.424444:0:5853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce813fcc00/0xb72beeaffa1b6bc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b6bcb expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579287.424449:0:5853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787579287.424480:0:5853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ce813fcc00/0xb72beeaffa1b6bc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6bcb expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.424486:0:5853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787579287.424502:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce813fcc00/0xb72beeaffa1b6bc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6bcb expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.424510:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce813fcc00/0xb72beeaffa1b6bc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6bcb expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.424525:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579287.424527:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579287.424529:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579287.424539:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616828800:0@lo:103: 00000100:00100000:0.0:1787579287.424571:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579287.424604:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616828800 00000100:00100000:0.0:1787579287.424608:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616828800 00010000:00010000:0.0:1787579287.424623:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ce80030c00/0xb72beeaffa1b6bcb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6bc4 expref: 17 pid: 5861 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579287.424643:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787579287.424648:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:3322:x1874412616828800:12345-0@lo:103: 00010000:00010000:0.0:1787579287.424657:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579287.424662:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ce80030c00/0xb72beeaffa1b6bcb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6bc4 expref: 17 pid: 5861 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.424682:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ce80030c00/0xb72beeaffa1b6bcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b6bc4 expref: 17 pid: 5861 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.424698:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0ceb3f78200/0xb72beeaffa1b6c9d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.424705:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceb3f78200/0xb72beeaffa1b6c9d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787579287.424717:0:5852:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002724517s 00010000:00010000:0.0:1787579287.424721:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0ceb3f78200/0xb72beeaffa1b6c9d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.424728:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0ceb3f78200/0xb72beeaffa1b6c9d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.424735:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0ceb3f78200/0xb72beeaffa1b6c9d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.424753:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0ceb3f78200/0xb72beeaffa1b6c9d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.424759:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb3f78200 already unused, calling callback (ffffffffc1654230) 00010000:00010000:0.0:1787579287.424763:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0ceb3f78200/0xb72beeaffa1b6c9d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.424770:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0ceb3f78200/0xb72beeaffa1b6c9d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.424778:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0ceb3f78200/0xb72beeaffa1b6c9d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579287.424787:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579287.424812:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:3322:x1874412616828800:12345-0@lo:103: Request processed in 164us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579287.424818:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1787579287.424967:0:5882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce80030c00/0xb72beeaffa1b6bcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b6bc4 expref: 16 pid: 5861 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579287.424979:0:5882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830edf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5882:1874412616828672:0@lo:104: 00010000:00010000:1.0:1787579287.424999:0:5882:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0ceb3f78200/0xb72beeaffa1b6c9d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.425008:0:5882:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0ceb3f78200/0xb72beeaffa1b6c9d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.425015:0:5882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0ceb3f78200/0xb72beeaffa1b6c9d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579287.425022:0:5882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ceb3f78200/0xb72beeaffa1b6c9d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579287.425691:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616828800:0@lo:103: 00000100:00100000:2.0:1787579287.436219:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:7649:x1874412616828416:12345-0@lo:253: Request processed in 38047us (38117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579287.436232:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787579287.436333:0:7649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:7649:1874412616828416:0@lo:253: 10000000:01000000:3.0:1787579287.436347:0:7649:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787579287.436351:0:7649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787579287.436353:0:7649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787579287.436354:0:7649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787579287.436355:0:7649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787579287.436356:0:7649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787579287.436358:0:7649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787579287.436359:0:7649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787579287.436360:0:7649:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787579287.436362:0:7649:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787579287.436363:0:7649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787579287.436365:0:7649:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787579287.436378:0:7649:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787579287.439142:0:7649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787579287.439303:0:7649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787579287.441180:0:7649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787579287.441435:0:7649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787579287.441888:0:7649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787579287.442119:0:7649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787579287.443892:0:7649:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787579287.615719:0:7649:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787579287.615725:0:7649:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787579287.615753:0:7649:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787579287.615801:0:7649:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.153@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787579287.615814:0:7649:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787579287.615837:0:7649:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1787579287.968262:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579288.032194:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616828928:0@lo:13: 00000100:00100000:1.0:1787579288.032263:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579288.032385:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616828928 00000100:00100000:0.0:1787579288.032393:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616828928 00000100:00100000:0.0:1787579288.032446:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787579288.032456:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616828928:12345-0@lo:13: 00002000:00000024:0.0:1787579288.032489:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579288.032541:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616828928:12345-0@lo:13: Request processed in 87us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579288.032548:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787579288.032888:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ce830ef800 x1874412616828928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579288.032906:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616828928:0@lo:13: 00010000:00010000:0.0:1787579288.992069:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579290.018101:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579291.040727:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579292.081881:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787579292.641056:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787579292.641065:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787579292.641068:0:36:0:(import.c:65:import_set_state_nolock()) ffffa0ceb3d49800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787579292.641076:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 223 00000100:00080000:0.0:1787579292.641080:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787579292.641086:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0ceb3d49800 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:0.0:1787579292.641103:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ce830ed880 x1874412616829568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787579292.641153:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616829184:0@lo:400: 00000100:00100000:0.0:1787579292.641207:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579292.641265:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787579292.641272:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616829312:0@lo:400: 00000100:00100000:0.0:1787579292.641292:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579292.641322:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616829568:0@lo:8: 00000100:00100000:0.0:1787579292.641348:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579292.641376:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616829184 00000100:00100000:0.0:1787579292.641382:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616829184 00000100:00100000:0.0:1787579292.641414:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616829312 00000100:00100000:0.0:1787579292.641416:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616829312 00000100:00100000:0.0:1787579292.641439:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787579292.641447:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616829184:12345-0@lo:400: 00000100:00100000:0.0:1787579292.641490:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616829184:12345-0@lo:400: Request processed in 43us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579292.641496:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787579292.641510:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787579292.641515:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616829312:12345-0@lo:400: 00000100:00100000:0.0:1787579292.641547:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616829312:12345-0@lo:400: Request processed in 32us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579292.641553:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1787579292.641573:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787579292.641594:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ce830ee300 x1874412616829312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579292.641606:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616829312:0@lo:400: 00010000:00080000:0.0:1787579292.641616:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ce830edf80 x1874412616829184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579292.641624:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616829184:0@lo:400: 00000100:00100000:2.0:1787579292.642304:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616829056:0@lo:400: 00000100:00100000:2.0:1787579292.642342:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579292.642366:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3320:1874412616829696:0@lo:400: 00000100:00100000:2.0:1787579292.642389:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579292.642406:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787579292.642423:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616829440:0@lo:400: 00000100:00100000:2.0:1787579292.642448:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579292.642474:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616829056 00000100:00100000:2.0:1787579292.642478:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616829056 00000100:00100000:2.0:1787579292.642506:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787579292.642513:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:3320:x1874412616829056:12345-0@lo:400: 00000100:00100000:2.0:1787579292.642544:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:3320:x1874412616829056:12345-0@lo:400: Request processed in 32us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579292.642551:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787579292.642574:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616829568 00000100:00100000:2.0:1787579292.642578:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616829568 00000100:00100000:2.0:1787579292.642591:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616829440 00000100:00100000:2.0:1787579292.642593:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616829440 00000100:00100000:2.0:1787579292.642618:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787579292.642623:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616829440:12345-0@lo:400: 00000100:00100000:2.0:1787579292.642665:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616829440:12345-0@lo:400: Request processed in 42us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579292.642671:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787579292.642683:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787579292.642687:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3318:x1874412616829568:12345-0@lo:8: 00010000:00080000:2.0:1787579292.642857:0:6712:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:2.0:1787579292.642889:0:6712:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb72beeaffa1b6ca4 00002000:00100000:2.0:1787579292.642903:0:6712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffffa0cebf25d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787579292.642907:0:6712:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1787579292.642910:0:6712:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787579292.643031:0:6712:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787579292.643168:0:6712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787579292.643188:0:6712:0:(import.c:65:import_set_state_nolock()) ffffa0cebf25e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787579292.643347:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1874412616829568:12345-0@lo:8: Request processed in 658us (1997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579292.643353:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787579292.643388:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ce830edc00 x1874412616829440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579292.643400:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616829440:0@lo:400: 00000100:00100000:2.0:1787579292.643410:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616829056:0@lo:400: 00000100:00080000:2.0:1787579292.643442:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787579292.643462:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ce830ed880 x1874412616829568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787579307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579292.643470:0:3318:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787579292.643476:0:3318:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787579292.643481:0:3318:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787579292.643485:0:3318:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787579292.643487:0:3318:0:(import.c:65:import_set_state_nolock()) ffffa0ceb3d49800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787579292.643500:0:3318:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787579292.643505:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616829568:0@lo:8: 00000100:00100000:2.0:1787579292.643523:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616829696 00000100:00100000:2.0:1787579292.643533:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616829696 00000100:00100000:2.0:1787579292.643565:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787579292.643572:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874412616829696:12345-0@lo:400: 00000100:00100000:2.0:1787579292.643615:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874412616829696:12345-0@lo:400: Request processed in 43us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579292.643620:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1787579292.643634:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787579292.643662:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceba314a80 x1874412616829696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579292.643671:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3320:1874412616829696:0@lo:400: 00000004:00080000:1.0:1787579292.649973:0:7656:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787579292.650972:0:7656:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 228842044168ns, next at 0ns, rc = 0 00000004:00080000:1.0:1787579292.739048:0:5888:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787579292.739354:0:7659:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787579292.739379:0:7659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba316d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7659:1874412616829952:0@lo:7: 00000100:00100000:0.0:1787579292.739433:0:7659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579292.739472:0:7659:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d11d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787579292.739483:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787579292.739494:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616829824:0@lo:13: 00000100:00100000:0.0:1787579292.739514:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579292.739538:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616829952 00000100:00100000:0.0:1787579292.739544:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616829952 00000100:00100000:0.0:1787579292.739587:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787579292.739596:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba315c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7659:x1874412616829952:12345-0@lo:7: 00000100:00100000:2.0:1787579292.748997:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616829824 00000100:00100000:2.0:1787579292.749011:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616829824 00000100:00100000:2.0:1787579292.749073:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787579292.749082:0:6713:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1787579292.749085:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba316300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3322:x1874412616829824:12345-0@lo:13: 00000100:00100000:1.0:1787579292.749093:0:6713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:2.0:1787579292.749117:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787579292.749213:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba316300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3322:x1874412616829824:12345-0@lo:13: Request processed in 130us (9695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579292.749222:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787579292.753951:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1787579292.753973:0:7670:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1787579292.754039:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceba317b80 x1874412616829824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579292.754074:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616829824:0@lo:13: 00002000:00080000:1.0:1787579292.754164:0:6712:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1787579292.754170:0:6712:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787579292.754246:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba315c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7659:x1874412616829952:12345-0@lo:7: Request processed in 14650us (14811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579292.754256:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787579292.754439:0:7659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceba316d80 x1874412616829952/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787579308 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579292.754449:0:7659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba316d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7659:1874412616829952:0@lo:7: 00000004:00080000:0.0:1787579292.754457:0:7659:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787579292.754485:0:7659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba316d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7659:1874412616830080:0@lo:5: 00000100:00100000:0.0:1787579292.754514:0:7659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579292.754589:0:7659:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d11d300 going to sleep for 11 seconds 00000100:00100000:2.0:1787579292.755209:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616830080 00000100:00100000:2.0:1787579292.755217:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616830080 00000100:00100000:2.0:1787579292.755266:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787579292.755276:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:7659:x1874412616830080:12345-0@lo:5: 00002000:00080000:2.0:1787579292.755479:0:7660:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787579292.755483:0:7660:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787579292.756302:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:7659:x1874412616830080:12345-0@lo:5: Request processed in 1026us (1785us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787579292.756311:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787579292.756322:0:7659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceba316d80 x1874412616830080/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787579308 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579292.756338:0:7659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba316d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7659:1874412616830080:0@lo:5: 00000004:00080000:0.0:1787579292.756349:0:7659:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787579292.756378:0:7659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba315500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7659:1874412616830208:0@lo:700: 00000100:00100000:0.0:1787579292.756405:0:7659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579292.756428:0:7659:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d11d300 going to sleep for 11 seconds 00000100:00100000:2.0:1787579292.756491:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616830208 00000100:00100000:2.0:1787579292.756497:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616830208 00000100:00100000:2.0:1787579292.756537:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787579292.756545:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba317800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:7659:x1874412616830208:12345-0@lo:700: 00000100:00100000:2.0:1787579292.756661:0:6718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6718:1874412616830336:0@lo:700: 00000100:00100000:2.0:1787579292.756692:0:6718:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579292.756714:0:6718:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cd833f5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787579292.756836:0:5873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616830336 00000100:00100000:1.0:1787579292.756841:0:5873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616830336 00000100:00100000:1.0:1787579292.756877:0:5873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787579292.756885:0:5873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6718:x1874412616830336:12345-0@lo:700: 40000000:02000000:0.0:1787579292.835913:0:5873:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1787579292.843894:0:5873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6718:x1874412616830336:12345-0@lo:700: Request processed in 87002us (87194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579292.843915:0:5873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787579292.844282:0:6718:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec119ed80 x1874412616830336/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787579308 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579292.844296:0:6718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6718:1874412616830336:0@lo:700: 40000000:02000000:1.0:1787579292.844308:0:6718:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:0.0:1787579292.936923:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1787579292.937193:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba317800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7659:x1874412616830208:12345-0@lo:700: Request processed in 180645us (180782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579292.937204:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787579292.937342:0:7659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceba315500 x1874412616830208/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787579308 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579292.937353:0:7659:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787579292.937375:0:7659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba315500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7659:1874412616830208:0@lo:700: 00000004:02000040:0.0:1787579292.972049:0:7659:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1787579292.976320:0:7659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba315500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7659:1874412616830464:0@lo:5: 00000100:00100000:0.0:1787579292.976383:0:7659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579292.976538:0:7659:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce98715f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787579292.976595:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616830464 00000100:00100000:1.0:1787579292.976602:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616830464 00000100:00100000:1.0:1787579292.976663:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787579292.976672:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba316d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7659:x1874412616830464:12345-0@lo:5: 00002000:00080000:0.0:1787579292.990017:0:6710:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787579292.990036:0:6710:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1787579293.004201:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba316d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7659:x1874412616830464:12345-0@lo:5: Request processed in 27523us (27810us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787579293.004214:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1787579293.004438:0:7659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceba315500 x1874412616830464/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787579308 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579293.004455:0:7659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba315500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7659:1874412616830464:0@lo:5: 00000004:00080000:1.0:1787579293.004470:0:7659:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1787579293.088518:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579293.153841:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616830592:0@lo:13: 00000100:00100000:0.0:1787579293.153905:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579293.162878:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616830592 00000100:00100000:2.0:1787579293.162892:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616830592 00000100:00100000:2.0:1787579293.162974:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787579293.162986:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba314e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616830592:12345-0@lo:13: 00002000:00000024:2.0:1787579293.163032:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579293.163123:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba314e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616830592:12345-0@lo:13: Request processed in 139us (9217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579293.163130:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787579293.163179:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceba316680 x1874412616830592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579293.163199:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616830592:0@lo:13: 00000001:02000400:1.0:1787579293.671308:0:8013:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg653-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787579294.112539:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787579294.178495:0:5863:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787579294.178500:0:5863:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0ce84eda800 from 30 10000000:01000000:3.0:1787579294.178504:0:5863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787579294.178539:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f200/0xb72beeaffa1b6cab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579294.178747:0:5863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f200/0xb72beeaffa1b6cab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579294.178759:0:5863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f200/0xb72beeaffa1b6cab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579294.178782:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616830720:0@lo:101: 00000100:00100000:3.0:1787579294.178838:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579294.178881:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceba1e0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787579294.179148:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616830720 00000100:00100000:1.0:1787579294.179155:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616830720 00000100:00100000:1.0:1787579294.179197:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787579294.179205:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:5863:x1874412616830720:12345-0@lo:101: 00010000:00010000:1.0:1787579294.179216:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579294.179227:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce8148b600/0xb72beeaffa1b6cb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6cab expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579294.179254:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce8148b600/0xb72beeaffa1b6cb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6cab expref: 16 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579294.179264:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce8148b600/0xb72beeaffa1b6cb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6cab expref: 16 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579294.179272:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8148b600, rc 0) 00000100:00100000:1.0:1787579294.179308:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:5863:x1874412616830720:12345-0@lo:101: Request processed in 104us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579294.179314:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787579294.179349:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616830720:0@lo:101: 00010000:00010000:1.0:1787579294.179361:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f200/0xb72beeaffa1b6cab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6cb2 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579294.179370:0:5863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f200/0xb72beeaffa1b6cab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6cb2 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579294.179421:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616830848:0@lo:501: 00000100:00100000:1.0:1787579294.179442:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579294.179453:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d11d300 going to sleep for 11 seconds 00000100:00100000:2.0:1787579294.179808:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616830848 00000100:00100000:2.0:1787579294.179813:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616830848 00000100:00100000:2.0:1787579294.179842:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787579294.179848:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:5863:x1874412616830848:12345-0@lo:501: 00000100:00100000:2.0:1787579294.180152:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:5863:x1874412616830848:12345-0@lo:501: Request processed in 304us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579294.180159:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787579294.183763:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616830848:0@lo:501: 00000100:00100000:1.0:1787579294.183814:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616830976:0@lo:503: 00000100:00100000:1.0:1787579294.183877:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579294.183920:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d11d300 going to sleep for 11 seconds 00000100:00100000:2.0:1787579294.183992:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616830976 00000100:00100000:2.0:1787579294.183998:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616830976 00000100:00100000:2.0:1787579294.184055:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787579294.184064:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:5863:x1874412616830976:12345-0@lo:503: 00000100:00100000:2.0:1787579294.184389:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:5863:x1874412616830976:12345-0@lo:503: Request processed in 325us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579294.184397:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787579294.185371:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616830976:0@lo:503: 00000100:00100000:1.0:1787579294.187379:0:8036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8036:1874412616831104:0@lo:502: 00000100:00100000:1.0:1787579294.187457:0:8036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579294.187489:0:8036:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d11da80 going to sleep for 11 seconds 00000100:00100000:2.0:1787579294.187539:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616831104 00000100:00100000:2.0:1787579294.187547:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616831104 00000100:00100000:2.0:1787579294.187608:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787579294.187617:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:8036:x1874412616831104:12345-0@lo:502: 00000100:00100000:2.0:1787579294.187905:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:8036:x1874412616831104:12345-0@lo:502: Request processed in 288us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579294.187912:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787579294.187985:0:8036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8036:1874412616831104:0@lo:502: 00000100:00100000:2.0:1787579294.188027:0:8036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8036:1874412616831232:0@lo:502: 00000100:00100000:2.0:1787579294.188060:0:8036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579294.188073:0:8036:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cd833f5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787579294.188238:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616831232 00000100:00100000:1.0:1787579294.188243:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616831232 00000100:00100000:1.0:1787579294.188271:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787579294.188279:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:8036:x1874412616831232:12345-0@lo:502: 00000100:00100000:1.0:1787579294.188422:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:8036:x1874412616831232:12345-0@lo:502: Request processed in 143us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579294.188429:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787579294.188776:0:8036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8036:1874412616831232:0@lo:502: 00000040:00080000:2.0:1787579294.188797:0:8036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787579294.189868:0:5863:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787579294.189891:0:5863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787579294.189901:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f200/0xb72beeaffa1b6cab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6cb2 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579294.189912:0:5863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f200/0xb72beeaffa1b6cab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6cb2 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579294.189921:0:5863:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787579294.189946:0:5863:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1787579294.189949:0:5863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787579294.189980:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6cb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579294.189994:0:5863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6cb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579294.190005:0:5863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6cb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579294.190022:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616831360:0@lo:101: 00000100:00100000:1.0:1787579294.190094:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579294.190144:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d11d840 going to sleep for 11 seconds 00000100:00100000:0.0:1787579294.190357:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616831360 00000100:00100000:0.0:1787579294.190364:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616831360 00000100:00100000:0.0:1787579294.190411:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787579294.190420:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:5863:x1874412616831360:12345-0@lo:101: 00010000:00010000:0.0:1787579294.190430:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579294.190442:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceb3f78800/0xb72beeaffa1b6cc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6cb9 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579294.190461:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceb3f78800/0xb72beeaffa1b6cc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6cb9 expref: 17 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579294.190471:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceb3f78800/0xb72beeaffa1b6cc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6cb9 expref: 17 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579294.190486:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb3f78800, rc 0) 00000100:00100000:0.0:1787579294.190527:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616831360:12345-0@lo:101: Request processed in 109us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579294.190533:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787579294.191616:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616831360:0@lo:101: 00010000:00010000:2.0:1787579294.191645:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6cb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6cc0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579294.191656:0:5863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6cb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6cc0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579294.191716:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616831488:0@lo:501: 00000100:00100000:2.0:1787579294.191763:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579294.191798:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cd833f5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787579294.191898:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616831488 00000100:00100000:1.0:1787579294.191903:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616831488 00000100:00100000:1.0:1787579294.191963:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787579294.191972:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616831488:12345-0@lo:501: 00000100:00100000:1.0:1787579294.192206:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616831488:12345-0@lo:501: Request processed in 234us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579294.192212:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787579294.192245:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616831488:0@lo:501: 00000100:00100000:1.0:1787579294.192284:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616831616:0@lo:503: 00000100:00100000:1.0:1787579294.192318:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579294.192330:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d11df00 going to sleep for 11 seconds 00000100:00100000:1.0:1787579294.192342:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616831616 00000100:00100000:1.0:1787579294.192345:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616831616 00000100:00100000:1.0:1787579294.192365:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787579294.192370:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616831616:12345-0@lo:503: 00000100:00100000:1.0:1787579294.192806:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616831616:12345-0@lo:503: Request processed in 433us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579294.192821:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787579294.192861:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616831616:0@lo:503: 00000100:00100000:1.0:1787579294.193037:0:8037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8037:1874412616831744:0@lo:502: 00000100:00100000:1.0:1787579294.193069:0:8037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579294.193091:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616831744 00000100:00100000:1.0:1787579294.193094:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616831744 00000100:00100000:1.0:1787579294.193115:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787579294.193121:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:8037:x1874412616831744:12345-0@lo:502: 00000100:00100000:1.0:1787579294.193837:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:8037:x1874412616831744:12345-0@lo:502: Request processed in 713us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579294.193846:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787579294.193889:0:8037:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d11d840 going to sleep for 11 seconds 00000100:00100000:1.0:1787579294.193903:0:8037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8037:1874412616831744:0@lo:502: 00000020:01000000:1.0:1787579294.194380:0:8037:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787579294.194390:0:8037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579294.194392:0:8037:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787579294.194397:0:8037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787579294.194399:0:8037:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787579294.194491:0:8037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8037:1874412616831872:0@lo:502: 00000100:00100000:1.0:1787579294.194533:0:8037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579294.194727:0:8037:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d11d840 going to sleep for 11 seconds 00000100:00100000:2.0:1787579294.201831:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616831872 00000100:00100000:2.0:1787579294.201845:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616831872 00000100:00100000:3.0:1787579294.202084:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787579294.202094:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:8037:x1874412616831872:12345-0@lo:502: 00000100:00100000:3.0:1787579294.202360:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:8037:x1874412616831872:12345-0@lo:502: Request processed in 267us (7825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579294.202367:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787579294.202885:0:8037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8037:1874412616831872:0@lo:502: 00000020:01000000:2.0:1787579294.202920:0:8037:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787579294.202956:0:8037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787579294.202959:0:8037:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787579294.202966:0:8037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787579294.203085:0:5863:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787579294.203104:0:5863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787579294.203113:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6cb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6cc0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579294.203124:0:5863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6cb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6cc0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579294.203134:0:5863:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787579294.203137:0:5863:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0ce90be4800 from 30 10000000:01000000:0.0:1787579294.203139:0:5863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787579294.203169:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6cc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579294.203176:0:5863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6cc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579294.203185:0:5863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6cc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579294.203202:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba316680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616832000:0@lo:101: 00000100:00100000:0.0:1787579294.203242:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579294.203278:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce98715180 going to sleep for 11 seconds 00000100:00100000:3.0:1787579294.203968:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616832000 00000100:00100000:3.0:1787579294.203976:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616832000 00000100:00100000:3.0:1787579294.204016:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787579294.204025:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616832000:12345-0@lo:101: 00010000:00010000:3.0:1787579294.204036:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579294.204047:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce8152f600/0xb72beeaffa1b6cce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6cc7 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579294.204066:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce8152f600/0xb72beeaffa1b6cce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6cc7 expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579294.204076:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce8152f600/0xb72beeaffa1b6cce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6cc7 expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579294.204100:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8152f600, rc 0) 00000100:00100000:3.0:1787579294.204139:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616832000:12345-0@lo:101: Request processed in 115us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579294.204145:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787579294.204447:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba316680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616832000:0@lo:101: 00010000:00010000:0.0:1787579294.204468:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6cc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6cce expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579294.204477:0:5863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6cc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6cce expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579294.204527:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba316680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616832128:0@lo:501: 00000100:00100000:0.0:1787579294.204554:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579294.205401:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce98715180 going to sleep for 11 seconds 00000100:00100000:3.0:1787579294.206262:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616832128 00000100:00100000:3.0:1787579294.206270:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616832128 00000100:00100000:3.0:1787579294.206320:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787579294.206328:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616832128:12345-0@lo:501: 00000100:00100000:3.0:1787579294.206956:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616832128:12345-0@lo:501: Request processed in 626us (2399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579294.206964:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787579294.207054:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba316680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616832128:0@lo:501: 00000100:00100000:1.0:1787579294.207094:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616832256:0@lo:503: 00000100:00100000:1.0:1787579294.207137:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579294.207158:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d11d900 going to sleep for 11 seconds 00000100:00100000:3.0:1787579294.207237:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616832256 00000100:00100000:3.0:1787579294.207241:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616832256 00000100:00100000:3.0:1787579294.207341:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787579294.207349:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616832256:12345-0@lo:503: 00000100:00100000:3.0:1787579294.207849:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616832256:12345-0@lo:503: Request processed in 500us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579294.207856:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787579294.208364:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616832256:0@lo:503: 00000100:00100000:3.0:1787579294.208921:0:8038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f16680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8038:1874412616832384:0@lo:502: 00000100:00100000:3.0:1787579294.209480:0:8038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579294.209556:0:8038:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb1c51000 going to sleep for 11 seconds 00000100:00100000:1.0:1787579294.210093:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616832384 00000100:00100000:1.0:1787579294.210101:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616832384 00000100:00100000:1.0:1787579294.210175:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787579294.210184:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:8038:x1874412616832384:12345-0@lo:502: 00000100:00100000:1.0:1787579294.210440:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:8038:x1874412616832384:12345-0@lo:502: Request processed in 257us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579294.210448:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787579294.210518:0:8038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f16680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8038:1874412616832384:0@lo:502: 00000100:00100000:2.0:1787579294.210599:0:8038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8038:1874412616832512:0@lo:502: 00000100:00100000:2.0:1787579294.210645:0:8038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579294.211070:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616832512 00000100:00100000:3.0:1787579294.211084:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616832512 00000100:00100000:2.0:1787579294.211088:0:8038:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cd833f53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787579294.211114:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787579294.211122:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:8038:x1874412616832512:12345-0@lo:502: 00000100:00100000:3.0:1787579294.211358:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:8038:x1874412616832512:12345-0@lo:502: Request processed in 235us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579294.211366:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787579294.211613:0:8038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8038:1874412616832512:0@lo:502: 00000040:00080000:2.0:1787579294.211647:0:8038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787579294.212181:0:5863:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787579294.212200:0:5863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787579294.212209:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6cc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6cce expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579294.212219:0:5863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6cc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6cce expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579294.212227:0:5863:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787579294.212230:0:5863:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0ce90be4800 from 5 10000000:01000000:1.0:1787579294.212232:0:5863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787579294.212260:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b400/0xb72beeaffa1b6cd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579294.212267:0:5863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b400/0xb72beeaffa1b6cd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579294.212276:0:5863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b400/0xb72beeaffa1b6cd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579294.212292:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616832640:0@lo:101: 00000100:00100000:1.0:1787579294.212339:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579294.212362:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d11d840 going to sleep for 11 seconds 00000100:00100000:0.0:1787579294.219747:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616832640 00000100:00100000:0.0:1787579294.219760:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616832640 00000100:00100000:0.0:1787579294.219820:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787579294.219830:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616832640:12345-0@lo:101: 00010000:00010000:0.0:1787579294.219845:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579294.219864:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceb3f79a00/0xb72beeaffa1b6cdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6cd5 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579294.219888:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceb3f79a00/0xb72beeaffa1b6cdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6cd5 expref: 19 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579294.219899:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceb3f79a00/0xb72beeaffa1b6cdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6cd5 expref: 19 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579294.219907:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb3f79a00, rc 0) 00000100:00100000:0.0:1787579294.219997:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:5863:x1874412616832640:12345-0@lo:101: Request processed in 168us (7656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579294.220004:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787579294.220698:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616832640:0@lo:101: 00010000:00010000:3.0:1787579294.220718:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b400/0xb72beeaffa1b6cd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6cdc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579294.220729:0:5863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b400/0xb72beeaffa1b6cd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6cdc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579294.220804:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616832768:0@lo:256: 00000100:00100000:3.0:1787579294.220846:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579294.220968:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce87c69540 going to sleep for 11 seconds 00000100:00100000:2.0:1787579294.221123:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616832768 00000100:00100000:2.0:1787579294.221130:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616832768 00000100:00100000:2.0:1787579294.221335:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787579294.221346:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:5863:x1874412616832768:12345-0@lo:256: 20000000:01000000:2.0:1787579294.221362:0:5860:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787579294.221376:0:5860:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787579294.221380:0:5860:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787579294.221467:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:5863:x1874412616832768:12345-0@lo:256: Request processed in 123us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579294.221474:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787579294.221529:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616832768:0@lo:256: 10000000:01000000:3.0:1787579294.221581:0:5863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787579294.221588:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b400/0xb72beeaffa1b6cd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6cdc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579294.221597:0:5863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b400/0xb72beeaffa1b6cd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6cdc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579295.144534:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579296.163454:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579297.190632:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579297.760798:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787579297.760832:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616832896:0@lo:13: 00000100:00100000:0.0:1787579297.760966:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579297.761068:0:7952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616832896 00000100:00100000:0.0:1787579297.761078:0:7952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616832896 00000100:00100000:0.0:1787579297.761157:0:7952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787579297.761167:0:7952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba314380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1874412616832896:12345-0@lo:13: 00002000:00000024:0.0:1787579297.761208:0:7952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579297.761256:0:7952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba314380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1874412616832896:12345-0@lo:13: Request processed in 90us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579297.761263:0:7952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787579297.761287:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787579297.761326:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceba315880 x1874412616832896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579297.761347:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616832896:0@lo:13: 00000100:00100000:3.0:1787579297.763213:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616833152:0@lo:400: 00000100:00100000:3.0:1787579297.763286:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579297.763327:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787579297.763333:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616833280:0@lo:400: 00000100:00100000:3.0:1787579297.763356:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579297.767062:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616833152 00000100:00100000:0.0:1787579297.767083:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616833152 00000100:00100000:0.0:1787579297.767291:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616833280 00000100:00100000:0.0:1787579297.767296:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616833280 00000100:00100000:0.0:1787579297.767334:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787579297.767345:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616833152:12345-0@lo:400: 00000100:00100000:0.0:1787579297.769599:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616833152:12345-0@lo:400: Request processed in 2237us (6294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579297.769630:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787579297.769685:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787579297.769704:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616833280:12345-0@lo:400: 00000100:00100000:0.0:1787579297.769805:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616833280:12345-0@lo:400: Request processed in 110us (6447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579297.769811:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1787579297.769861:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787579297.769920:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ce84f15f80 x1874412616833280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579297.769955:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616833280:0@lo:400: 00010000:00080000:0.0:1787579297.769972:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ce84f15500 x1874412616833152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579297.769981:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616833152:0@lo:400: 00000100:00100000:0.0:1787579297.770024:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616833024:0@lo:400: 00000100:00100000:0.0:1787579297.770084:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579297.770138:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3320:1874412616833536:0@lo:400: 00000100:00100000:0.0:1787579297.770168:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579297.770189:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787579297.770196:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616833408:0@lo:400: 00000100:00100000:0.0:1787579297.770221:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579297.770254:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616833408 00000100:00100000:0.0:1787579297.770260:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616833408 00000100:00100000:0.0:1787579297.770312:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787579297.770319:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616833408:12345-0@lo:400: 00000100:00100000:0.0:1787579297.770354:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616833408:12345-0@lo:400: Request processed in 36us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579297.770361:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787579297.770374:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787579297.770389:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ce84f16680 x1874412616833408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579297.770399:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616833408:0@lo:400: 00000100:00100000:0.0:1787579297.770426:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616833536 00000100:00100000:0.0:1787579297.770429:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616833536 00000100:00100000:0.0:1787579297.770456:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787579297.770462:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874412616833536:12345-0@lo:400: 00000100:00100000:0.0:1787579297.770494:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874412616833536:12345-0@lo:400: Request processed in 32us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579297.770500:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787579297.770514:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787579297.770528:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ce84f17800 x1874412616833536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579297.770538:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3320:1874412616833536:0@lo:400: 00000100:00100000:0.0:1787579297.770598:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616833024 00000100:00100000:0.0:1787579297.770602:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616833024 00000100:00100000:0.0:1787579297.770643:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787579297.770650:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3320:x1874412616833024:12345-0@lo:400: 00000100:00100000:0.0:1787579297.770681:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3320:x1874412616833024:12345-0@lo:400: Request processed in 33us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579297.770687:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787579297.770719:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616833024:0@lo:400: 00010000:00010000:1.0:1787579298.213679:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579298.275320:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616833664:0@lo:13: 00000100:00100000:0.0:1787579298.275466:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579298.287527:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616833664 00000100:00100000:2.0:1787579298.288488:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616833664 00000100:00100000:2.0:1787579298.288721:0:7952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787579298.288734:0:7952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616833664:12345-0@lo:13: 00002000:00000024:2.0:1787579298.288781:0:7952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579298.288890:0:7952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616833664:12345-0@lo:13: Request processed in 158us (13423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579298.288898:0:7952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787579298.288985:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec119df80 x1874412616833664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579314 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579298.289009:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616833664:0@lo:13: 00000001:00080000:0.0:1787579298.409535:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1787579299.232099:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579300.256262:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579300.338819:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579300.338913:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591645056 00000100:00100000:3.0:1787579300.338923:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591645056 00000100:00100000:3.0:1787579300.338995:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 110 00000100:00100000:3.0:1787579300.339004:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2358:x1874412591645056:12345-192.168.206.53@tcp:250: 00010000:00080000:3.0:1787579300.339048:0:5860:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 803d6039-c137-4d52-85de-c5895e5f2411@192.168.206.53@tcp t0 exp 0000000000000000 cur 236 last 0 00000020:00000080:3.0:1787579300.339076:0:5860:0:(genops.c:1385:class_connect()) connect: client 803d6039-c137-4d52-85de-c5895e5f2411, cookie 0xb72beeaffa1b6ce3 00000100:00080000:3.0:1787579300.339204:0:5860:0:(import.c:65:import_set_state_nolock()) ffffa0cebfaa6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787579300.339271:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+5:2358:x1874412591645056:12345-192.168.206.53@tcp:250: Request processed in 267us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579300.339279:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 110 00000100:00100000:0.0:1787579300.341890:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579300.341988:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591644928 00000100:00100000:2.0:1787579300.341998:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591644928 00000100:00100000:2.0:1787579300.342189:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 111 00000100:00100000:2.0:1787579300.342201:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+5:5589:x1874412591644928:12345-192.168.206.53@tcp:101: 00010000:00010000:2.0:1787579300.342217:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579300.342235:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6cea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cdea expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579300.342262:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6cea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cdea expref: 6 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579300.342273:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6cea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cdea expref: 6 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579300.342281:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce813fda00, rc 0) 00000100:00100000:2.0:1787579300.342557:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+6:5589:x1874412591644928:12345-192.168.206.53@tcp:101: Request processed in 358us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579300.342578:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 111 00000100:00100000:1.0:1787579300.351826:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579300.352222:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591645184 00000100:00100000:3.0:1787579300.352233:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591645184 00000100:00100000:3.0:1787579300.352421:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 112 00000100:00100000:3.0:1787579300.352434:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+6:5589:x1874412591645184:12345-192.168.206.53@tcp:501: 00000100:00100000:3.0:1787579300.352991:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+6:5589:x1874412591645184:12345-192.168.206.53@tcp:501: Request processed in 558us (1172us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787579300.354544:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 112 00000100:00100000:3.0:1787579300.358201:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579300.358953:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591645312 00000100:00100000:2.0:1787579300.358963:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591645312 00000100:00100000:2.0:1787579300.359025:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 113 00000100:00100000:2.0:1787579300.359048:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+6:5589:x1874412591645312:12345-192.168.206.53@tcp:101: 00010000:00010000:2.0:1787579300.359063:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579300.359081:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce813fc200/0xb72beeaffa1b6cf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cdf1 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579300.359110:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce813fc200/0xb72beeaffa1b6cf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cdf1 expref: 7 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579300.359121:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce813fc200/0xb72beeaffa1b6cf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cdf1 expref: 7 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579300.359130:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce813fc200, rc 0) 00000100:00100000:2.0:1787579300.359191:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+7:5589:x1874412591645312:12345-192.168.206.53@tcp:101: Request processed in 145us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579300.359197:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 113 00000100:00100000:1.0:1787579300.363325:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579300.363672:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591645440 00000100:00100000:3.0:1787579300.363683:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591645440 00000100:00100000:3.0:1787579300.363736:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 114 00000100:00100000:3.0:1787579300.363746:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+7:5589:x1874412591645440:12345-192.168.206.53@tcp:501: 00000100:00100000:3.0:1787579300.364152:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+8:5589:x1874412591645440:12345-192.168.206.53@tcp:501: Request processed in 406us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579300.364161:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 114 00000100:00100000:1.0:1787579300.372741:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579300.377025:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591645568 00000100:00100000:0.0:1787579300.377039:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591645568 00000100:00100000:0.0:1787579300.377118:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 115 00000100:00100000:0.0:1787579300.377130:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+8:5589:x1874412591645568:12345-192.168.206.53@tcp:503: 00000100:00100000:0.0:1787579300.377678:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+8:5589:x1874412591645568:12345-192.168.206.53@tcp:503: Request processed in 547us (4942us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579300.377686:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 115 00000100:00100000:0.0:1787579300.387764:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579300.388290:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591645696 00000100:00100000:2.0:1787579300.388301:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591645696 00000100:00100000:2.0:1787579300.388357:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 116 00000100:00100000:2.0:1787579300.388367:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+8:5608:x1874412591645696:12345-192.168.206.53@tcp:502: 00000100:00100000:2.0:1787579300.388742:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+8:5608:x1874412591645696:12345-192.168.206.53@tcp:502: Request processed in 371us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579300.388751:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 116 00000100:00100000:1.0:1787579300.413234:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579300.413320:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591645824 00000100:00100000:0.0:1787579300.413330:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591645824 00000100:00100000:0.0:1787579300.413390:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 117 00000100:00100000:0.0:1787579300.413401:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+8:5608:x1874412591645824:12345-192.168.206.53@tcp:502: 00000100:00100000:0.0:1787579300.413687:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+8:5608:x1874412591645824:12345-192.168.206.53@tcp:502: Request processed in 287us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579300.413695:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 117 00000100:00100000:1.0:1787579300.419078:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579300.419165:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591645952 00000100:00100000:2.0:1787579300.419192:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591645952 00000100:00100000:2.0:1787579300.419257:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 118 00000100:00100000:2.0:1787579300.419269:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+8:5589:x1874412591645952:12345-192.168.206.53@tcp:101: 00010000:00010000:2.0:1787579300.419290:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579300.419308:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce813fc000/0xb72beeaffa1b6cf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01ce1b expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579300.419338:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce813fc000/0xb72beeaffa1b6cf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce1b expref: 9 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579300.419349:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce813fc000/0xb72beeaffa1b6cf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce1b expref: 9 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579300.419359:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce813fc000, rc 0) 00000100:00100000:2.0:1787579300.419436:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+9:5589:x1874412591645952:12345-192.168.206.53@tcp:101: Request processed in 169us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579300.419443:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 118 00000100:00100000:1.0:1787579300.426239:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579300.426465:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591646080 00000100:00100000:3.0:1787579300.426487:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591646080 00000100:00100000:3.0:1787579300.426549:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 119 00000100:00100000:3.0:1787579300.426559:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb1d50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+9:5589:x1874412591646080:12345-192.168.206.53@tcp:256: 20000000:01000000:3.0:1787579300.426585:0:5860:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787579300.426610:0:5860:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787579300.426614:0:5860:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787579300.426618:0:5860:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787579300.426620:0:5860:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787579300.429959:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb1d50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+9:5589:x1874412591646080:12345-192.168.206.53@tcp:256: Request processed in 3356us (3683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579300.429973:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 119 00000100:00100000:1.0:1787579300.433244:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579300.433530:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591646208 00000100:00100000:0.0:1787579300.433550:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591646208 00000100:00100000:0.0:1787579300.433607:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 120 00000100:00100000:0.0:1787579300.433618:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb1d53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+9:5589:x1874412591646208:12345-192.168.206.53@tcp:101: 00010000:00010000:0.0:1787579300.433633:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579300.433649:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceb3f79200/0xb72beeaffa1b6cff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01ce22 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579300.433675:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceb3f79200/0xb72beeaffa1b6cff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce22 expref: 10 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579300.433684:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceb3f79200/0xb72beeaffa1b6cff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce22 expref: 10 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579300.433708:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb3f79200, rc 0) 00000100:00100000:0.0:1787579300.433762:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb1d53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+10:5589:x1874412591646208:12345-192.168.206.53@tcp:101: Request processed in 146us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579300.433770:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 120 00000100:00100000:1.0:1787579300.445042:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579300.445132:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591646336 00000100:00100000:3.0:1787579300.445142:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591646336 00000100:00100000:3.0:1787579300.445200:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 121 00000100:00100000:3.0:1787579300.445210:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb1d53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+10:5589:x1874412591646336:12345-192.168.206.53@tcp:501: 00000100:00100000:3.0:1787579300.445503:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb1d53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+10:5589:x1874412591646336:12345-192.168.206.53@tcp:501: Request processed in 293us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579300.445512:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 121 00000100:00100000:1.0:1787579300.450127:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579300.450217:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591646464 00000100:00100000:2.0:1787579300.450228:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591646464 00000100:00100000:2.0:1787579300.450283:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 122 00000100:00100000:2.0:1787579300.450293:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce857d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+10:5589:x1874412591646464:12345-192.168.206.53@tcp:503: 00000100:00100000:2.0:1787579300.450675:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce857d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+10:5589:x1874412591646464:12345-192.168.206.53@tcp:503: Request processed in 382us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579300.450688:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 122 00000100:00100000:1.0:1787579300.453662:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579300.453752:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591646592 00000100:00100000:0.0:1787579300.453761:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591646592 00000100:00100000:0.0:1787579300.453810:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 123 00000100:00100000:0.0:1787579300.453820:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce857d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+10:5612:x1874412591646592:12345-192.168.206.53@tcp:502: 00000100:00100000:0.0:1787579300.454103:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce857d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+10:5612:x1874412591646592:12345-192.168.206.53@tcp:502: Request processed in 284us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579300.454112:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 123 00000100:00100000:1.0:1787579300.460724:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579300.460809:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591646720 00000100:00100000:3.0:1787579300.460819:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591646720 00000100:00100000:3.0:1787579300.460881:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 124 00000100:00100000:3.0:1787579300.460892:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+10:5612:x1874412591646720:12345-192.168.206.53@tcp:502: 00000100:00100000:3.0:1787579300.461148:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+10:5612:x1874412591646720:12345-192.168.206.53@tcp:502: Request processed in 257us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579300.461156:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 124 00000100:00100000:1.0:1787579300.477739:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579300.477843:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591646848 00000100:00100000:0.0:1787579300.477852:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591646848 00000100:00100000:0.0:1787579300.477916:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 4 00000100:00100000:0.0:1787579300.477924:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2358:x1874412591646848:12345-192.168.206.53@tcp:38: 00010000:00080000:0.0:1787579300.477975:0:5867:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 963d8c17-1326-491b-be60-9002b9296555@192.168.206.53@tcp t0 exp 0000000000000000 cur 236 last 0 00000020:00000080:0.0:1787579300.478025:0:5867:0:(genops.c:1385:class_connect()) connect: client 963d8c17-1326-491b-be60-9002b9296555, cookie 0xb72beeaffa1b6d06 00000004:00100000:0.0:1787579300.478059:0:5867:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787579300.478065:0:5867:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1787579300.534562:0:5867:0:(import.c:65:import_set_state_nolock()) ffffa0ceb44b4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787579300.534654:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+6:2358:x1874412591646848:12345-192.168.206.53@tcp:38: Request processed in 56727us (56921us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579300.534665:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 4 00010000:00010000:0.0:1787579301.280081:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579301.542666:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579301.542814:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591646976 00000100:00100000:2.0:1787579301.542824:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591646976 00000100:00100000:2.0:1787579301.542989:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:2.0:1787579301.543001:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+6:0:x1874412591646976:12345-192.168.206.53@tcp:41: 00000004:00000024:2.0:1787579301.543051:0:5868:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787579301.543151:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+6:0:x1874412591646976:12345-192.168.206.53@tcp:41: Request processed in 152us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579301.543158:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:2.0:1787579301.544725:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579301.545043:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591647104 00000100:00100000:3.0:1787579301.545052:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591647104 00000100:00100000:3.0:1787579301.545111:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:3.0:1787579301.545120:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+6:5589:x1874412591647104:12345-192.168.206.53@tcp:41: 00000004:00000024:3.0:1787579301.545144:0:5867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787579301.545192:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+6:5589:x1874412591647104:12345-192.168.206.53@tcp:41: Request processed in 73us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579301.545199:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00080000:0.0:1787579301.550459:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787579301.557771:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579301.557848:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591647232 00000100:00100000:3.0:1787579301.557856:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591647232 00000100:00100000:3.0:1787579301.557957:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:3.0:1787579301.557967:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+6:5589:x1874412591647232:12345-192.168.206.53@tcp:40: 00000100:00100000:3.0:1787579301.558037:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+6:5589:x1874412591647232:12345-192.168.206.53@tcp:40: Request processed in 72us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579301.558044:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:1.0:1787579301.564172:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579301.564248:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579301.564453:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591647360 00000100:00100000:0.0:1787579301.564463:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591647360 00000100:00100000:0.0:1787579301.564512:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00100000:0.0:1787579301.564520:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1874412591647360:12345-192.168.206.53@tcp:8: 00010000:00080000:0.0:1787579301.564567:0:6712:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 963d8c17-1326-491b-be60-9002b9296555@192.168.206.53@tcp t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:0.0:1787579301.564612:0:6712:0:(genops.c:1385:class_connect()) connect: client 963d8c17-1326-491b-be60-9002b9296555, cookie 0xb72beeaffa1b6d0d 00002000:00100000:0.0:1787579301.564623:0:6712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 963d8c17-1326-491b-be60-9002b9296555/ffffa0ceb3e14000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787579301.564646:0:6712:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787579301.564959:0:6712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787579301.564985:0:6712:0:(import.c:65:import_set_state_nolock()) ffffa0ceb3e12800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787579301.565041:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+6:2358:x1874412591647360:12345-192.168.206.53@tcp:8: Request processed in 521us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579301.565049:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00100000:2.0:1787579301.565286:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591647616 00000100:00100000:2.0:1787579301.565292:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591647616 00000100:00100000:2.0:1787579301.565331:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 125 00000100:00100000:2.0:1787579301.565338:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84e09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+10:2359:x1874412591647616:12345-192.168.206.53@tcp:400: 00000100:00100000:2.0:1787579301.565376:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84e09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+10:2359:x1874412591647616:12345-192.168.206.53@tcp:400: Request processed in 29us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579301.565383:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 125 00000100:00100000:3.0:1787579301.565803:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579301.565880:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579301.566489:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591647488 00000100:00100000:2.0:1787579301.566496:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591647488 00000100:00100000:2.0:1787579301.566527:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:2.0:1787579301.566543:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1874412591647488:12345-192.168.206.53@tcp:8: 00010000:00080000:2.0:1787579301.566566:0:6711:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 963d8c17-1326-491b-be60-9002b9296555@192.168.206.53@tcp t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:2.0:1787579301.566590:0:6711:0:(genops.c:1385:class_connect()) connect: client 963d8c17-1326-491b-be60-9002b9296555, cookie 0xb72beeaffa1b6d14 00002000:00100000:2.0:1787579301.566610:0:6711:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 963d8c17-1326-491b-be60-9002b9296555/ffffa0cebf25c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787579301.566629:0:6711:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787579301.566895:0:6711:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787579301.566919:0:6711:0:(import.c:65:import_set_state_nolock()) ffffa0cebf258000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787579301.566995:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+6:2358:x1874412591647488:12345-192.168.206.53@tcp:8: Request processed in 451us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579301.567017:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:0.0:1787579301.568976:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591647744 00000100:00100000:0.0:1787579301.568989:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591647744 00000100:00100000:0.0:1787579301.569043:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:0.0:1787579301.569052:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+6:5589:x1874412591647744:12345-192.168.206.53@tcp:33: 00000004:00080000:0.0:1787579301.586517:0:5869:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 17408us 00000004:00200000:0.0:1787579301.596292:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787579301.596458:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+6:5589:x1874412591647744:12345-192.168.206.53@tcp:33: Request processed in 27402us (30572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579301.596469:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:1.0:1787579301.762560:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579301.763149:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591647872 00000100:00100000:2.0:1787579301.763160:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591647872 00000100:00100000:2.0:1787579301.763223:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:2.0:1787579301.763234:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+6:5630:x1874412591647872:12345-192.168.206.53@tcp:101: 00010000:00010000:2.0:1787579301.763253:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579301.763277:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fcc00/0xb72beeaffa1b6d1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01ce4c expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579301.763339:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b6d22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579301.763352:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b6d22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579301.763366:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b6d22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579301.763674:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787579301.763680:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787579301.763763:0:5868:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b6d22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579301.763791:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fcc00/0xb72beeaffa1b6d1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce4c expref: 8 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579301.763807:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b6d22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce4c expref: 7 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579301.763827:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0cea147d500) 00010000:00010000:2.0:1787579301.763829:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787579301.763833:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce80030c00, rc 0) 00000100:00100000:2.0:1787579301.764043:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+7:5630:x1874412591647872:12345-192.168.206.53@tcp:101: Request processed in 810us (1491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579301.764051:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 8 00010000:00010000:1.0:1787579302.306567:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579302.880202:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616833792:0@lo:13: 00000100:00100000:2.0:1787579302.880270:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579302.880396:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616833792 00000100:00100000:0.0:1787579302.880405:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616833792 00000100:00100000:0.0:1787579302.880474:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787579302.880492:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616833792:12345-0@lo:13: 00002000:00000024:0.0:1787579302.880525:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579302.880567:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616833792:12345-0@lo:13: Request processed in 77us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579302.880602:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787579302.880782:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceba316a00 x1874412616833792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579302.880792:0:3322:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787579302.880811:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616833792:0@lo:13: 00000100:00100000:2.0:1787579302.881016:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616834176:0@lo:400: 00000100:00100000:2.0:1787579302.881049:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579302.881071:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787579302.881077:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616834304:0@lo:400: 00000100:00100000:2.0:1787579302.881101:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579302.881125:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616834176 00000100:00100000:2.0:1787579302.881129:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616834176 00000100:00100000:2.0:1787579302.881162:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787579302.881170:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616834176:12345-0@lo:400: 00000100:00100000:2.0:1787579302.881206:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616834176:12345-0@lo:400: Request processed in 37us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579302.881212:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787579302.881251:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616834176:0@lo:400: 00000100:00100000:0.0:1787579302.881319:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616833920:0@lo:400: 00000100:00100000:0.0:1787579302.881352:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579302.881390:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1874412616834432:0@lo:400: 00000100:00100000:0.0:1787579302.881412:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579302.881428:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787579302.881433:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616834048:0@lo:400: 00000100:00100000:0.0:1787579302.881454:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579302.881490:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616834304 00000100:00100000:0.0:1787579302.881494:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616834304 00000100:00100000:0.0:1787579302.881521:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787579302.881527:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616834304:12345-0@lo:400: 00000100:00100000:0.0:1787579302.881558:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616834304:12345-0@lo:400: Request processed in 31us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579302.881564:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787579302.881579:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616834432 00000100:00100000:0.0:1787579302.881582:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616834432 00000100:00100000:0.0:1787579302.881621:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616834048 00000100:00100000:0.0:1787579302.881624:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616834048 00000100:00100000:0.0:1787579302.881635:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787579302.881640:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874412616834432:12345-0@lo:400: 00000100:00100000:0.0:1787579302.881667:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874412616834432:12345-0@lo:400: Request processed in 27us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579302.881672:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787579302.881682:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787579302.881687:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616834048:12345-0@lo:400: 00000100:00100000:0.0:1787579302.881717:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616834048:12345-0@lo:400: Request processed in 30us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579302.881723:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1787579302.881746:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec119f100 x1874412616834304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579302.881757:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616834304:0@lo:400: 00000100:00100000:0.0:1787579302.881774:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616834048:0@lo:400: 00000100:00100000:0.0:1787579302.881781:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1874412616834432:0@lo:400: 00000100:00100000:2.0:1787579302.881988:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616833920 00000100:00100000:2.0:1787579302.881993:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616833920 00000100:00100000:2.0:1787579302.882024:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787579302.882031:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84e0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3319:x1874412616833920:12345-0@lo:400: 00000100:00100000:2.0:1787579302.882074:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84e0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3319:x1874412616833920:12345-0@lo:400: Request processed in 43us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579302.882080:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787579302.882158:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616833920:0@lo:400: 00000100:00080000:1.0:1787579302.883527:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787579302.883535:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787579302.883537:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787579303.328671:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579303.393152:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616834560:0@lo:13: 00000100:00100000:3.0:1787579303.393365:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579303.393604:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616834560 00000100:00100000:2.0:1787579303.393612:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616834560 00000100:00100000:2.0:1787579303.393707:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787579303.393719:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616834560:12345-0@lo:13: 00002000:00000024:2.0:1787579303.393750:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579303.393817:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616834560:12345-0@lo:13: Request processed in 101us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579303.393825:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787579303.393897:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec119d180 x1874412616834560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579303.393914:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616834560:0@lo:13: 00000100:00100000:3.0:1787579303.726281:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579303.726339:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591648000 00000100:00100000:0.0:1787579303.726349:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591648000 00000100:00080000:1.0:1787579303.726470:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579303.726599:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00100000:0.0:1787579303.726613:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+7:5682:x1874412591648000:12345-192.168.206.53@tcp:41: 00000004:00000024:0.0:1787579303.726652:0:5866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787579303.726726:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+7:5682:x1874412591648000:12345-192.168.206.53@tcp:41: Request processed in 115us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579303.726734:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00100000:1.0:1787579303.737413:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579303.737480:0:7952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591648128 00000100:00100000:2.0:1787579303.737489:0:7952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591648128 00000100:00100000:2.0:1787579303.737556:0:7952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00080000:1.0:1787579303.737561:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787579303.737566:0:7952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:963d8c17-1326-491b-be60-9002b9296555+6:5682:x1874412591648128:12345-192.168.206.53@tcp:13: 00002000:00000024:2.0:1787579303.737611:0:7952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579303.737680:0:7952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:963d8c17-1326-491b-be60-9002b9296555+6:5682:x1874412591648128:12345-192.168.206.53@tcp:13: Request processed in 114us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579303.737687:0:7952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00100000:1.0:1787579303.742433:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579303.742514:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591648256 00000100:00100000:2.0:1787579303.742523:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591648256 00000100:00100000:2.0:1787579303.742598:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:2.0:1787579303.742622:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:963d8c17-1326-491b-be60-9002b9296555+6:5682:x1874412591648256:12345-192.168.206.53@tcp:13: 00000100:00080000:1.0:1787579303.742622:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1787579303.742777:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579303.742836:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:963d8c17-1326-491b-be60-9002b9296555+6:5682:x1874412591648256:12345-192.168.206.53@tcp:13: Request processed in 217us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579303.742844:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 10 00010000:00010000:1.0:1787579304.352118:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787579304.966700:0:7670:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 963d8c17-1326-491b-be60-9002b9296555 00010000:00010000:0.0:1787579305.376071:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787579305.999464:0:8321:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1787579306.011847:0:5888:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 963d8c17-1326-491b-be60-9002b9296555 00000001:00100000:0.0:1787579306.031723:0:6735:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 963d8c17-1326-491b-be60-9002b9296555 00010000:00010000:1.0:1787579306.400200:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579306.676309:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579306.676387:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579306.676422:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579306.676450:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579306.676484:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591648768 00000100:00100000:2.0:1787579306.676493:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591648768 00000100:00100000:2.0:1787579306.676544:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591648640 00000100:00100000:2.0:1787579306.676548:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591648640 00000100:00100000:2.0:1787579306.676583:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:2.0:1787579306.676593:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+5:2359:x1874412591648768:12345-192.168.206.53@tcp:400: 00000100:00100000:2.0:1787579306.676669:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+5:2359:x1874412591648768:12345-192.168.206.53@tcp:400: Request processed in 78us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579306.676677:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:2.0:1787579306.676720:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:2.0:1787579306.676727:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+5:2359:x1874412591648640:12345-192.168.206.53@tcp:400: 00000100:00100000:2.0:1787579306.676753:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+5:2359:x1874412591648640:12345-192.168.206.53@tcp:400: Request processed in 27us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579306.676759:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00080000:2.0:1787579306.676776:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787579306.676780:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787579306.677238:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591648384 00000100:00100000:0.0:1787579306.677243:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591648384 00000100:00100000:0.0:1787579306.677289:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 127 00000100:00100000:0.0:1787579306.677296:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+10:2359:x1874412591648384:12345-192.168.206.53@tcp:400: 00000100:00100000:0.0:1787579306.677333:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+10:2359:x1874412591648384:12345-192.168.206.53@tcp:400: Request processed in 38us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579306.677352:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 127 00000100:00100000:3.0:1787579306.680995:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591648512 00000100:00100000:3.0:1787579306.681009:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591648512 00000100:00100000:2.0:1787579306.681235:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 19 00000100:00100000:2.0:1787579306.681250:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+6:2359:x1874412591648512:12345-192.168.206.53@tcp:400: 00000100:00100000:2.0:1787579306.681333:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+6:2359:x1874412591648512:12345-192.168.206.53@tcp:400: Request processed in 89us (5034us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579306.681341:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 19 00000100:00080000:3.0:1787579306.681394:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787579307.425322:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579308.002609:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616834688:0@lo:13: 00000100:00100000:1.0:1787579308.002672:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579308.002824:0:7952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616834688 00000100:00100000:2.0:1787579308.002832:0:7952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616834688 00000100:00100000:2.0:1787579308.002888:0:7952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787579308.002898:0:7952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616834688:12345-0@lo:13: 00002000:00000024:2.0:1787579308.002950:0:7952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579308.002993:0:7952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616834688:12345-0@lo:13: Request processed in 97us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579308.003000:0:7952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1787579308.003035:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec1a64380 x1874412616834688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579308.003052:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616834688:0@lo:13: 00000100:00080000:1.0:1787579308.003112:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787579308.006138:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616834944:0@lo:400: 00000100:00100000:3.0:1787579308.006201:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579308.006237:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787579308.006244:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616835072:0@lo:400: 00000100:00100000:3.0:1787579308.006276:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579308.006308:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616834944 00000100:00100000:3.0:1787579308.006314:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616834944 00000100:00100000:3.0:1787579308.006352:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616835072 00000100:00100000:3.0:1787579308.006355:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616835072 00000100:00100000:3.0:1787579308.006378:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787579308.006386:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616834944:12345-0@lo:400: 00000100:00100000:3.0:1787579308.006430:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616834944:12345-0@lo:400: Request processed in 45us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579308.006436:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787579308.006450:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787579308.006455:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616835072:12345-0@lo:400: 00000100:00100000:3.0:1787579308.006497:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616835072:12345-0@lo:400: Request processed in 41us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579308.006502:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787579308.006536:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616835072:0@lo:400: 00000100:00100000:3.0:1787579308.006546:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616834944:0@lo:400: 00000100:00080000:3.0:1787579308.006582:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787579308.006592:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616835200:0@lo:400: 00000100:00100000:3.0:1787579308.006620:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579308.006638:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787579308.006643:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616834816:0@lo:400: 00000100:00100000:3.0:1787579308.006666:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579308.006689:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1874412616835328:0@lo:400: 00000100:00100000:3.0:1787579308.006713:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579308.006735:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616835200 00000100:00100000:3.0:1787579308.006744:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616835200 00000100:00100000:3.0:1787579308.006776:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787579308.006782:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616835200:12345-0@lo:400: 00000100:00100000:3.0:1787579308.006817:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616835200:12345-0@lo:400: Request processed in 35us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579308.006823:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787579308.006839:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616834816 00000100:00100000:3.0:1787579308.006842:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616834816 00000100:00100000:3.0:1787579308.006864:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787579308.006870:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce85749850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3321:x1874412616834816:12345-0@lo:400: 00000100:00100000:3.0:1787579308.006897:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce85749850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3321:x1874412616834816:12345-0@lo:400: Request processed in 28us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579308.006903:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787579308.006951:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616835328 00000100:00100000:3.0:1787579308.006955:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616835328 00000100:00100000:3.0:1787579308.006977:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787579308.006983:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874412616835328:12345-0@lo:400: 00000100:00100000:3.0:1787579308.007011:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874412616835328:12345-0@lo:400: Request processed in 28us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579308.007016:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1787579308.007034:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787579308.007037:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787579308.007050:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616834816:0@lo:400: 00000100:00100000:3.0:1787579308.007059:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1874412616835328:0@lo:400: 00010000:00080000:3.0:1787579308.007069:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec1a60000 x1874412616835200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579308.007077:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616835200:0@lo:400: 00010000:00010000:2.0:1787579308.449152:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579308.512070:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616835456:0@lo:13: 00000100:00100000:0.0:1787579308.512132:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579308.512203:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616835456 00000100:00100000:0.0:1787579308.512210:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616835456 00000100:00100000:0.0:1787579308.512252:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787579308.512261:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba316680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616835456:12345-0@lo:13: 00002000:00000024:0.0:1787579308.512290:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579308.512343:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba316680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616835456:12345-0@lo:13: Request processed in 83us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579308.512349:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787579308.512389:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceba315500 x1874412616835456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579308.512404:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616835456:0@lo:13: 00000020:00000080:2.0:1787579309.121047:0:8470:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc38ad0950 20000000:00000080:2.0:1787579309.121073:0:8470:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0cebf868000 uarg=0000000000000000 20000000:01000000:2.0:1787579309.121125:0:8470:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1787579309.121128:0:8470:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1787579309.121132:0:8470:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787579309.121138:0:8470:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787579309.121146:0:8470:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1787579309.121168:0:8470:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787579309.121171:0:8470:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787579309.121405:0:8470:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787579309.121408:0:8470:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787579309.122700:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1787579309.123483:0:8470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1787579309.123546:0:8470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1787579309.123615:0:8470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1787579309.123631:0:8470:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787579309.123634:0:8470:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787579309.124508:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1787579309.124915:0:8470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1787579309.125071:0:8470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1787579309.125113:0:8470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1787579309.125127:0:8470:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787579309.125130:0:8470:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787579309.125835:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1787579309.126280:0:8470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1787579309.126339:0:8470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1787579309.126376:0:8470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1787579309.126389:0:8470:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787579309.126392:0:8470:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787579309.127078:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1787579309.127414:0:8470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1787579309.127440:0:8470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1787579309.127457:0:8470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:1.0:1787579309.127468:0:8470:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787579309.127487:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0ce8148b200/0xb72beeaffa1b6d29 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.127505:0:8470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ce8148b000/0xb72beeaffa1b6c26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6c1f expref: 18 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.127510:0:8470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6c49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6c42 expref: 18 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.127515:0:8470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ceb3f79000/0xb72beeaffa1b6c57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6c50 expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.127532:0:8470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ceb3f79600/0xb72beeaffa1b6c81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6c7a expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.127540:0:8470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ce8148b600/0xb72beeaffa1b6cb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6cab expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.127547:0:8470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ceb3f78800/0xb72beeaffa1b6cc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6cb9 expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.127569:0:8470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ce8152f600/0xb72beeaffa1b6cce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6cc7 expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.127580:0:8470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6cea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cdea expref: 9 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.127588:0:8470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ce813fc200/0xb72beeaffa1b6cf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cdf1 expref: 9 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.127596:0:8470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0ce8148b200/0xb72beeaffa1b6d29 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.127640:0:8470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ce813fc200/0xb72beeaffa1b6cf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cdf1 expref: 9 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.127654:0:8470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0ce813fc200/0xb72beeaffa1b6cf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cdf1 expref: 9 pid: 5861 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579309.127668:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a64000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1874412616835584:192.168.206.53@tcp:104: 00010000:00010000:1.0:1787579309.127778:0:8470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6cea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cdea expref: 9 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.127793:0:8470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6cea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cdea expref: 9 pid: 5861 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579309.127801:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1874412616835712:192.168.206.53@tcp:104: 00010000:00010000:1.0:1787579309.127834:0:8470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ce8152f600/0xb72beeaffa1b6cce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b6cc7 expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.127842:0:8470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0ce8152f600/0xb72beeaffa1b6cce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b6cc7 expref: 18 pid: 5860 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579309.127851:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a65180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1874412616835840:0@lo:104: 00000100:00100000:1.0:1787579309.127899:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787579309.128022:0:8470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ceb3f78800/0xb72beeaffa1b6cc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b6cb9 expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.128031:0:8470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0ceb3f78800/0xb72beeaffa1b6cc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b6cb9 expref: 18 pid: 5861 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579309.128039:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a64a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1874412616835968:0@lo:104: 00010000:00010000:1.0:1787579309.128064:0:8470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ce8148b600/0xb72beeaffa1b6cb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b6cab expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.128072:0:8470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0ce8148b600/0xb72beeaffa1b6cb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b6cab expref: 18 pid: 5860 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579309.128080:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a67100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1874412616836096:0@lo:104: 00010000:00010000:1.0:1787579309.128103:0:8470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ceb3f79600/0xb72beeaffa1b6c81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b6c7a expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.128118:0:8470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0ceb3f79600/0xb72beeaffa1b6c81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b6c7a expref: 18 pid: 5860 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579309.128127:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a65f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1874412616836224:0@lo:104: 00010000:00010000:1.0:1787579309.128154:0:8470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ceb3f79000/0xb72beeaffa1b6c57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b6c50 expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.128162:0:8470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0ceb3f79000/0xb72beeaffa1b6c57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b6c50 expref: 18 pid: 5861 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579309.128170:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a64700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1874412616836352:0@lo:104: 00010000:00010000:1.0:1787579309.128196:0:8470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6c49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b6c42 expref: 18 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.128203:0:8470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6c49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b6c42 expref: 18 pid: 5859 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579309.128210:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a67b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1874412616836480:0@lo:104: 00010000:00010000:1.0:1787579309.128228:0:8470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ce8148b000/0xb72beeaffa1b6c26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b6c1f expref: 18 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.128235:0:8470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0ce8148b000/0xb72beeaffa1b6c26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b6c1f expref: 18 pid: 5859 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579309.128241:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a66d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1874412616836608:0@lo:104: 00000100:00100000:1.0:1787579309.128273:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cebf3bda80 going to sleep for 11 seconds 00000100:00100000:0.0:1787579309.128331:0:5849:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787579309.128351:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579309.128411:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616835840 00000100:00100000:3.0:1787579309.128420:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616835840 00000100:00100000:0.0:1787579309.128426:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579309.128437:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579309.128445:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579309.128453:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579309.128462:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616835968 00000100:00100000:3.0:1787579309.128465:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616835968 00000100:00100000:0.0:1787579309.128469:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579309.128475:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616836096 00000100:00100000:0.0:1787579309.128477:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616836224 00000100:00100000:3.0:1787579309.128478:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616836096 00000100:00100000:0.0:1787579309.128479:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616836224 00000100:00100000:3.0:1787579309.128486:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616836352 00000100:00100000:3.0:1787579309.128488:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616836352 00000100:00100000:0.0:1787579309.128493:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616836480 00000100:00100000:0.0:1787579309.128495:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616836480 00000100:00100000:3.0:1787579309.128496:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616836608 00000100:00100000:3.0:1787579309.128497:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616836608 00000100:00100000:0.0:1787579309.128509:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787579309.128528:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfb23c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+9:8470:x1874412616835840:12345-0@lo:104: 00010000:00010000:0.0:1787579309.128544:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6cc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6cce expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579309.128634:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787579309.128640:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfb23c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+9:8470:x1874412616835840:12345-0@lo:104: Request processed in 125us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579309.128647:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787579309.128652:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a65180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1874412616835840:0@lo:104: 00000100:00100000:0.0:1787579309.128688:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787579309.128694:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba315500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+8:8470:x1874412616835968:12345-0@lo:104: 00010000:00010000:0.0:1787579309.128703:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6cb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6cc0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579309.128752:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787579309.128757:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba315500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+8:8470:x1874412616835968:12345-0@lo:104: Request processed in 64us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579309.128762:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787579309.128774:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787579309.128780:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba314a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+7:8470:x1874412616836096:12345-0@lo:104: 00010000:00010000:0.0:1787579309.128787:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f200/0xb72beeaffa1b6cab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6cb2 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579309.128813:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787579309.128823:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba314a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+7:8470:x1874412616836096:12345-0@lo:104: Request processed in 44us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579309.128824:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a64a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1874412616835968:0@lo:104: 00000100:00100000:0.0:1787579309.128829:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787579309.128839:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a67100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1874412616836096:0@lo:104: 00010000:00010000:3.0:1787579309.128886:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787579309.128894:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6cc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6cce expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579309.128902:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb3f79e00 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:3.0:1787579309.128906:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6cc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b6cce expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579309.128916:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6cc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b6cce expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579309.128969:0:5853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:3.0:1787579309.129000:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6cc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b6cce expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579309.129008:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787579309.129038:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787579309.129045:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+6:8470:x1874412616836224:12345-0@lo:104: 00010000:00010000:0.0:1787579309.129053:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc800/0xb72beeaffa1b6c7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6c81 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579309.129086:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6cc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6cce expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579309.129094:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787579309.129115:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6cc7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6cce expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579309.129132:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6cc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6cce expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579309.129153:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787579309.129159:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+6:8470:x1874412616836224:12345-0@lo:104: Request processed in 116us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579309.129166:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787579309.129184:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787579309.129190:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+5:8470:x1874412616836352:12345-0@lo:104: 00010000:00010000:0.0:1787579309.129197:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6c57 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579309.129263:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a65f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1874412616836224:0@lo:104: 00000100:00100000:1.0:1787579309.129270:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a64700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1874412616836352:0@lo:104: 00010000:00010000:3.0:1787579309.129315:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787579309.129315:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1787579309.129319:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f200/0xb72beeaffa1b6cab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6cb2 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579309.129320:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+5:8470:x1874412616836352:12345-0@lo:104: Request processed in 131us (874us total) trans 0 rc 0/0 00010000:00010000:3.0:1787579309.129326:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8152f200 already unused, calling callback (ffffffffc1c71c20) 00000100:00100000:0.0:1787579309.129327:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 10000000:00010000:3.0:1787579309.129330:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f200/0xb72beeaffa1b6cab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b6cb2 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579309.129337:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f200/0xb72beeaffa1b6cab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b6cb2 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579309.129339:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 10000000:00010000:3.0:1787579309.129344:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f200/0xb72beeaffa1b6cab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b6cb2 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579309.129345:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+4:8470:x1874412616836480:12345-0@lo:104: 10000000:01000000:3.0:1787579309.129350:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787579309.129352:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b800/0xb72beeaffa1b6c42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6c49 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579309.129390:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787579309.129401:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+4:8470:x1874412616836480:12345-0@lo:104: Request processed in 57us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579309.129407:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787579309.129408:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a67b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1874412616836480:0@lo:104: 00000100:00100000:0.0:1787579309.129420:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787579309.129426:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+3:8470:x1874412616836608:12345-0@lo:104: 00010000:00010000:0.0:1787579309.129434:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6c1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6c26 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579309.129457:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f200/0xb72beeaffa1b6cab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6cb2 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579309.129465:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787579309.129474:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787579309.129479:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+3:8470:x1874412616836608:12345-0@lo:104: Request processed in 54us (1009us total) trans 0 rc 0/0 00010000:00010000:3.0:1787579309.129483:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f200/0xb72beeaffa1b6cab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6cb2 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579309.129485:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1787579309.129490:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f200/0xb72beeaffa1b6cab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6cb2 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579309.129500:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787579309.129508:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc800/0xb72beeaffa1b6c7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6c81 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579309.129509:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616836736:0@lo:103: 00010000:00010000:3.0:1787579309.129514:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce813fc800 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:3.0:1787579309.129517:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc800/0xb72beeaffa1b6c7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b6c81 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579309.129524:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc800/0xb72beeaffa1b6c7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b6c81 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787579309.129530:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc800/0xb72beeaffa1b6c7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b6c81 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579309.129536:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787579309.129582:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a66d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1874412616836608:0@lo:104: 00000100:00100000:0.0:1787579309.129601:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579309.129639:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616836736 00000100:00100000:1.0:1787579309.129644:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616836736 00010000:00010000:1.0:1787579309.129668:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ce8152f600/0xb72beeaffa1b6cce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6cc7 expref: 19 pid: 5860 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579309.129694:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787579309.129702:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce90aba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3320:x1874412616836736:12345-0@lo:103: 00010000:00010000:1.0:1787579309.129714:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787579309.129720:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ce8152f600/0xb72beeaffa1b6cce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6cc7 expref: 19 pid: 5860 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.129729:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ce8152f600/0xb72beeaffa1b6cce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b6cc7 expref: 19 pid: 5860 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.129744:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce8152f600/0xb72beeaffa1b6cce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b6cc7 expref: 19 pid: 5860 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.129758:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787579309.129793:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce90aba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:3320:x1874412616836736:12345-0@lo:103: Request processed in 92us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579309.129800:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787579309.129966:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616836864:0@lo:103: 00000100:00100000:2.0:1787579309.129999:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579309.130065:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616836864 00000100:00100000:1.0:1787579309.130070:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616836864 00010000:00010000:1.0:1787579309.130092:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ce8148b600/0xb72beeaffa1b6cb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6cab expref: 18 pid: 5860 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579309.130113:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787579309.130120:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:3321:x1874412616836864:12345-0@lo:103: 00010000:00010000:1.0:1787579309.130127:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787579309.130131:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ce8148b600/0xb72beeaffa1b6cb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6cab expref: 18 pid: 5860 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.130140:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ce8148b600/0xb72beeaffa1b6cb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b6cab expref: 18 pid: 5860 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.130151:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce8148b600/0xb72beeaffa1b6cb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b6cab expref: 18 pid: 5860 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.130160:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579309.130177:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616836736:0@lo:103: 00000100:00100000:1.0:1787579309.130192:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:3321:x1874412616836864:12345-0@lo:103: Request processed in 74us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579309.130198:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1787579309.130241:0:8475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787579309.130256:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6cb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6cc0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.130264:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148a200 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:1.0:1787579309.130267:0:5853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6cb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b6cc0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.130274:0:5853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6cb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b6cc0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787579309.130280:0:5853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6cb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b6cc0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579309.130291:0:5853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787579309.130315:0:5853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6cb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6cc0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.130321:0:5853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787579309.130328:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6cb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6cc0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.130334:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6cb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6cc0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.130346:0:5853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787579309.130349:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b800/0xb72beeaffa1b6c42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6c49 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.130355:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148b800 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:1.0:1787579309.130358:0:5853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b800/0xb72beeaffa1b6c42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b6c49 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.130365:0:5853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b800/0xb72beeaffa1b6c42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b6c49 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787579309.130371:0:5853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b800/0xb72beeaffa1b6c42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b6c49 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579309.130376:0:5853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787579309.130389:0:5853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b800/0xb72beeaffa1b6c42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6c49 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.130395:0:5853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787579309.130396:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616836864:0@lo:103: 00000100:00100000:2.0:1787579309.130408:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787579309.130414:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616836992:0@lo:103: 00010000:00010000:1.0:1787579309.130421:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b800/0xb72beeaffa1b6c42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6c49 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.130428:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b800/0xb72beeaffa1b6c42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6c49 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579309.130436:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787579309.130437:0:5853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787579309.130440:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6c1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6c26 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.130447:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8152e200 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:1.0:1787579309.130450:0:5853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6c1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b6c26 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.130456:0:5853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6c1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b6c26 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579309.130457:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616836992 00000100:00100000:2.0:1787579309.130460:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616836992 10000000:00010000:1.0:1787579309.130463:0:5853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6c1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b6c26 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579309.130468:0:5853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787579309.130475:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ceb3f78800/0xb72beeaffa1b6cc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6cb9 expref: 17 pid: 5861 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.130480:0:5853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6c1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6c26 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.130486:0:5853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787579309.130492:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1787579309.130492:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6c1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6c26 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579309.130497:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:3321:x1874412616836992:12345-0@lo:103: 00010000:00010000:1.0:1787579309.130498:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6c1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6c26 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579309.130504:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579309.130508:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ceb3f78800/0xb72beeaffa1b6cc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6cb9 expref: 17 pid: 5861 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.130508:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579309.130514:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579309.130516:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579309.130599:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616837120:0@lo:103: 00010000:00010000:2.0:1787579309.130611:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ceb3f78800/0xb72beeaffa1b6cc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b6cb9 expref: 17 pid: 5861 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579309.130624:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ceb3f78800/0xb72beeaffa1b6cc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b6cb9 expref: 17 pid: 5861 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579309.130627:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787579309.130634:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579309.130653:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787579309.130659:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:3321:x1874412616836992:12345-0@lo:103: Request processed in 162us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579309.130659:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616837248:0@lo:103: 00000100:00100000:2.0:1787579309.130665:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787579309.130677:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616837120 00000100:00100000:0.0:1787579309.130678:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579309.130681:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616837120 00010000:00010000:2.0:1787579309.130692:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6c49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6c42 expref: 16 pid: 5859 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579309.130703:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616837248 00000100:00100000:2.0:1787579309.130706:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616837248 00010000:00010000:2.0:1787579309.130716:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ce8148b000/0xb72beeaffa1b6c26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6c1f expref: 17 pid: 5859 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579309.130729:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787579309.130732:0:5850:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787579309.130735:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:3319:x1874412616837120:12345-0@lo:103: 00000100:00100000:1.0:1787579309.130739:0:5850:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1787579309.130741:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579309.130745:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6c49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6c42 expref: 17 pid: 5859 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579309.130753:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6c49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b6c42 expref: 17 pid: 5859 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579309.130775:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6c49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b6c42 expref: 17 pid: 5859 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579309.130787:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579309.130825:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:3319:x1874412616837120:12345-0@lo:103: Request processed in 91us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579309.130900:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616837120:0@lo:103: 00000100:00100000:2.0:1787579309.130910:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787579309.130945:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787579309.130953:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:3319:x1874412616837248:12345-0@lo:103: 00010000:00010000:2.0:1787579309.130961:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579309.130966:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ce8148b000/0xb72beeaffa1b6c26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6c1f expref: 15 pid: 5859 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579309.130974:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ce8148b000/0xb72beeaffa1b6c26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b6c1f expref: 15 pid: 5859 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579309.130984:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce8148b000/0xb72beeaffa1b6c26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b6c1f expref: 15 pid: 5859 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579309.130992:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579309.131021:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:3319:x1874412616837248:12345-0@lo:103: Request processed in 70us (342us total) trans 0 rc 0/0 00010000:00010000:3.0:1787579309.131797:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc800/0xb72beeaffa1b6c7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6c81 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579309.131808:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787579309.131819:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc800/0xb72beeaffa1b6c7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6c81 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579309.131826:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce813fc800/0xb72beeaffa1b6c7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6c81 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579309.131912:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579309.131915:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579309.131918:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579309.132050:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787579309.132066:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616837376:0@lo:103: 00000100:00100000:3.0:1787579309.132231:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579309.132268:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616837376 00000100:00100000:0.0:1787579309.132276:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616837376 00000100:00100000:2.0:1787579309.132296:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1787579309.132298:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ceb3f79600/0xb72beeaffa1b6c81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6c7a expref: 15 pid: 5860 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579309.132318:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787579309.132326:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:3322:x1874412616837376:12345-0@lo:103: 00010000:00010000:2.0:1787579309.132337:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579309.132343:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ceb3f79600/0xb72beeaffa1b6c81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6c7a expref: 14 pid: 5860 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579309.132366:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ceb3f79600/0xb72beeaffa1b6c81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b6c7a expref: 14 pid: 5860 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579309.132378:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ceb3f79600/0xb72beeaffa1b6c81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b6c7a expref: 14 pid: 5860 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579309.132389:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579309.132468:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:3322:x1874412616837376:12345-0@lo:103: Request processed in 143us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579309.132475:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787579309.132512:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616836992:0@lo:103: 00000100:00100000:2.0:1787579309.132550:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616837248:0@lo:103: 00000100:00100000:3.0:1787579309.132647:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616837376:0@lo:103: 00010000:00010000:2.0:1787579309.132913:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579309.132916:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579309.132919:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579309.133050:0:8475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6c57 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579309.133065:0:8475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148a000 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:0.0:1787579309.133069:0:8475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b6c57 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579309.133077:0:8475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6c50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b6c57 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787579309.133082:0:8475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6c50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b6c57 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579309.133097:0:8475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787579309.133138:0:8475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6c50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6c57 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579309.133144:0:8475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787579309.133165:0:8475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6c50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6c57 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579309.133172:0:8475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a000/0xb72beeaffa1b6c50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6c57 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579309.133187:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579309.133188:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579309.133190:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579309.133300:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787579309.133312:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616837504:0@lo:103: 00000100:00100000:2.0:1787579309.133351:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579309.133435:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616837504 00000100:00100000:0.0:1787579309.133441:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616837504 00010000:00010000:0.0:1787579309.133463:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ceb3f79000/0xb72beeaffa1b6c57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6c50 expref: 13 pid: 5861 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579309.133496:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787579309.133513:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:3321:x1874412616837504:12345-0@lo:103: 00010000:00010000:0.0:1787579309.133523:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579309.133529:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ceb3f79000/0xb72beeaffa1b6c57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6c50 expref: 13 pid: 5861 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579309.133538:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ceb3f79000/0xb72beeaffa1b6c57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b6c50 expref: 13 pid: 5861 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579309.133569:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ceb3f79000/0xb72beeaffa1b6c57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b6c50 expref: 13 pid: 5861 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579309.133580:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579309.133654:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:3321:x1874412616837504:12345-0@lo:103: Request processed in 143us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579309.133662:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787579309.133708:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616837504:0@lo:103: 00000100:00100000:1.0:1787579309.134799:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a64000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1874412616835584:192.168.206.53@tcp:104: 00000100:00100000:1.0:1787579309.134812:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8470:1874412616835712:192.168.206.53@tcp:104: 00010000:00010000:1.0:1787579309.134871:0:8470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0ce8148b200/0xb72beeaffa1b6d29 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579309.135395:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579309.135427:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579309.135521:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591648896 00000100:00100000:3.0:1787579309.135528:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591648896 00010000:00010000:3.0:1787579309.135571:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ce813fc200/0xb72beeaffa1b6cf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cdf1 expref: 10 pid: 5861 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579309.135601:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591649024 00000100:00100000:3.0:1787579309.135603:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591649024 00010000:00010000:3.0:1787579309.135614:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6cea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cdea expref: 11 pid: 5861 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579309.135635:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 19 00000100:00100000:3.0:1787579309.135643:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce90abb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:803d6039-c137-4d52-85de-c5895e5f2411+11:2359:x1874412591648896:12345-192.168.206.53@tcp:103: 00010000:00010000:3.0:1787579309.135656:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579309.135661:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ce813fc200/0xb72beeaffa1b6cf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cdf1 expref: 11 pid: 5861 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579309.135674:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ce813fc200/0xb72beeaffa1b6cf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cdf1 expref: 11 pid: 5861 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579309.135696:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce813fc200/0xb72beeaffa1b6cf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cdf1 expref: 11 pid: 5861 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579309.135709:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787579309.135723:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 20 00000100:00100000:1.0:1787579309.135735:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:803d6039-c137-4d52-85de-c5895e5f2411+10:2360:x1874412591649024:12345-192.168.206.53@tcp:103: 00010000:00010000:1.0:1787579309.135746:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787579309.135752:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6cea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cdea expref: 10 pid: 5861 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.135764:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6cea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cdea expref: 10 pid: 5861 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579309.135768:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce90abb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:803d6039-c137-4d52-85de-c5895e5f2411+10:2359:x1874412591648896:12345-192.168.206.53@tcp:103: Request processed in 122us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579309.135782:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 19 00010000:00010000:1.0:1787579309.135786:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6cea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cdea expref: 10 pid: 5861 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.135802:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0ce8148b200/0xb72beeaffa1b6d29 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.135812:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce8148b200/0xb72beeaffa1b6d29 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.135828:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0ce8148b200/0xb72beeaffa1b6d29 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.135847:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0ce8148b200/0xb72beeaffa1b6d29 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.135856:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0ce8148b200/0xb72beeaffa1b6d29 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.135864:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0ce8148b200/0xb72beeaffa1b6d29 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.135870:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148b200 already unused, calling callback (ffffffffc1654230) 00010000:00010000:1.0:1787579309.135875:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0ce8148b200/0xb72beeaffa1b6d29 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.135884:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0ce8148b200/0xb72beeaffa1b6d29 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.135901:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0ce8148b200/0xb72beeaffa1b6d29 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.135911:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787579309.136049:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:803d6039-c137-4d52-85de-c5895e5f2411+8:2360:x1874412591649024:12345-192.168.206.53@tcp:103: Request processed in 317us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579309.136056:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 20 00010000:00010000:1.0:1787579309.136081:0:8470:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0ce8148b200/0xb72beeaffa1b6d29 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.136090:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0ce8148b200/0xb72beeaffa1b6d29 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.136096:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce8148b200/0xb72beeaffa1b6d29 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579309.482812:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787579310.240043:0:5863:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787579310.240054:0:5863:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0ceb3138000 from 39 10000000:01000000:3.0:1787579310.240062:0:5863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787579310.240288:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8152fe00/0xb72beeaffa1b6d30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579310.240302:0:5863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ce8152fe00/0xb72beeaffa1b6d30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579310.240396:0:5863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce8152fe00/0xb72beeaffa1b6d30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579310.240431:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616837632:0@lo:101: 00000100:00100000:3.0:1787579310.240523:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579310.240631:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce90922a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787579310.241287:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616837632 00000100:00100000:2.0:1787579310.241300:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616837632 00000100:00100000:2.0:1787579310.241442:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787579310.241454:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce85749050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+12:5863:x1874412616837632:12345-0@lo:101: 00010000:00010000:2.0:1787579310.241472:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579310.241494:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce80031c00/0xb72beeaffa1b6d37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6d30 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579310.241544:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce80031c00/0xb72beeaffa1b6d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6d30 expref: 13 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579310.241568:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce80031c00/0xb72beeaffa1b6d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6d30 expref: 13 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579310.241578:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce80031c00, rc 0) 00000100:00100000:2.0:1787579310.241655:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce85749050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:5863:x1874412616837632:12345-0@lo:101: Request processed in 203us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579310.241662:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787579310.241829:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616837632:0@lo:101: 00010000:00010000:0.0:1787579310.241851:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce8152fe00/0xb72beeaffa1b6d30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6d37 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579310.241919:0:5863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce8152fe00/0xb72beeaffa1b6d30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6d37 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579310.242039:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616837760:0@lo:501: 00000100:00100000:0.0:1787579310.242081:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579310.242835:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce878c1480 going to sleep for 11 seconds 00000100:00100000:3.0:1787579310.243284:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616837760 00000100:00100000:3.0:1787579310.243295:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616837760 00000100:00100000:3.0:1787579310.243442:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787579310.243453:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8574b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:5863:x1874412616837760:12345-0@lo:501: 00000100:00100000:3.0:1787579310.244639:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8574b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:5863:x1874412616837760:12345-0@lo:501: Request processed in 1182us (2550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579310.244652:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787579310.245303:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616837760:0@lo:501: 00000100:00100000:0.0:1787579310.245453:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616837888:0@lo:503: 00000100:00100000:0.0:1787579310.245519:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579310.245583:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce878c1480 going to sleep for 11 seconds 00000100:00100000:1.0:1787579310.246047:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616837888 00000100:00100000:1.0:1787579310.246056:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616837888 00000100:00100000:1.0:1787579310.246301:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787579310.246313:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce85748c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:5863:x1874412616837888:12345-0@lo:503: 00000100:00100000:1.0:1787579310.246575:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce85748c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:5863:x1874412616837888:12345-0@lo:503: Request processed in 263us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579310.246583:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787579310.246677:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616837888:0@lo:503: 00000100:00100000:1.0:1787579310.249810:0:8491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8491:1874412616838016:0@lo:502: 00000100:00100000:1.0:1787579310.249955:0:8491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579310.250009:0:8491:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cebf3bdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787579310.250123:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616838016 00000100:00100000:3.0:1787579310.250133:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616838016 00000100:00100000:3.0:1787579310.250205:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787579310.250217:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce85749450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:8491:x1874412616838016:12345-0@lo:502: 00000100:00100000:3.0:1787579310.250541:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce85749450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:8491:x1874412616838016:12345-0@lo:502: Request processed in 326us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579310.250559:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787579310.251049:0:8491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8491:1874412616838016:0@lo:502: 00000100:00100000:1.0:1787579310.251124:0:8491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8491:1874412616838144:0@lo:502: 00000100:00100000:1.0:1787579310.251182:0:8491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579310.251218:0:8491:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cebf3bdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787579310.251401:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616838144 00000100:00100000:3.0:1787579310.251407:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616838144 00000100:00100000:3.0:1787579310.251451:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787579310.251469:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8574bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:8491:x1874412616838144:12345-0@lo:502: 00000100:00100000:3.0:1787579310.251677:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8574bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:8491:x1874412616838144:12345-0@lo:502: Request processed in 209us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579310.251686:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787579310.252465:0:8491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8491:1874412616838144:0@lo:502: 00000040:00080000:1.0:1787579310.252504:0:8491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787579310.252730:0:5863:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787579310.252755:0:5863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787579310.252767:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8152fe00/0xb72beeaffa1b6d30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6d37 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579310.252780:0:5863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce8152fe00/0xb72beeaffa1b6d30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6d37 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579310.252791:0:5863:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1787579310.252794:0:5863:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1787579310.252797:0:5863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787579310.252833:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79c00/0xb72beeaffa1b6d3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579310.252841:0:5863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79c00/0xb72beeaffa1b6d3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579310.252851:0:5863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79c00/0xb72beeaffa1b6d3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579310.253026:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616838272:0@lo:101: 00000100:00100000:0.0:1787579310.253078:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579310.253125:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce878c1480 going to sleep for 11 seconds 00000100:00100000:2.0:1787579310.253286:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616838272 00000100:00100000:2.0:1787579310.253294:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616838272 00000100:00100000:2.0:1787579310.253347:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787579310.253356:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91ddac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+13:5863:x1874412616838272:12345-0@lo:101: 00010000:00010000:2.0:1787579310.253370:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579310.253384:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce80031400/0xb72beeaffa1b6d45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6d3e expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579310.253408:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce80031400/0xb72beeaffa1b6d45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6d3e expref: 14 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579310.253420:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce80031400/0xb72beeaffa1b6d45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6d3e expref: 14 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579310.253429:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce80031400, rc 0) 00000100:00100000:2.0:1787579310.253471:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91ddac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:5863:x1874412616838272:12345-0@lo:101: Request processed in 116us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579310.253477:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787579310.253685:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616838272:0@lo:101: 00010000:00010000:0.0:1787579310.253720:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79c00/0xb72beeaffa1b6d3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6d45 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579310.253731:0:5863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79c00/0xb72beeaffa1b6d3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6d45 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579310.253778:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616838400:0@lo:501: 00000100:00100000:0.0:1787579310.253803:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579310.253825:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce878c1480 going to sleep for 11 seconds 00000100:00100000:3.0:1787579310.253990:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616838400 00000100:00100000:3.0:1787579310.253995:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616838400 00000100:00100000:3.0:1787579310.254026:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787579310.254033:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:5863:x1874412616838400:12345-0@lo:501: 00000100:00100000:3.0:1787579310.254440:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:5863:x1874412616838400:12345-0@lo:501: Request processed in 406us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579310.254448:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787579310.255104:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616838400:0@lo:501: 00000100:00100000:0.0:1787579310.255151:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616838528:0@lo:503: 00000100:00100000:0.0:1787579310.255390:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579310.255434:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce878c1480 going to sleep for 11 seconds 00000100:00100000:2.0:1787579310.255507:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616838528 00000100:00100000:2.0:1787579310.255513:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616838528 00000100:00100000:2.0:1787579310.255568:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787579310.255579:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:5863:x1874412616838528:12345-0@lo:503: 00000100:00100000:2.0:1787579310.255877:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:5863:x1874412616838528:12345-0@lo:503: Request processed in 281us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579310.255886:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787579310.265914:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616838528:0@lo:503: 00000100:00100000:1.0:1787579310.266821:0:8492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8492:1874412616838656:0@lo:502: 00000100:00100000:1.0:1787579310.266970:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579310.267026:0:8492:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cebf3bd300 going to sleep for 11 seconds 00000100:00100000:2.0:1787579310.267280:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616838656 00000100:00100000:2.0:1787579310.267290:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616838656 00000100:00100000:2.0:1787579310.267361:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787579310.267373:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce85748450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:8492:x1874412616838656:12345-0@lo:502: 00000100:00100000:2.0:1787579310.267670:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce85748450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:8492:x1874412616838656:12345-0@lo:502: Request processed in 298us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579310.267679:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787579310.268037:0:8492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8492:1874412616838656:0@lo:502: 00000020:01000000:1.0:1787579310.268073:0:8492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787579310.268091:0:8492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579310.268093:0:8492:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787579310.268098:0:8492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787579310.268129:0:8492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8492:1874412616838784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787579310.268283:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579310.268401:0:8492:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cebf3bd300 going to sleep for 11 seconds 00000100:00100000:0.0:1787579310.272855:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616838784 00000100:00100000:0.0:1787579310.272884:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616838784 00000100:00100000:0.0:1787579310.272991:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787579310.273005:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:8492:x1874412616838784:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787579310.273706:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:8492:x1874412616838784:12345-0@lo:502:llog_process_th.0 Request processed in 694us (5412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579310.273716:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787579310.273896:0:8492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8492:1874412616838784:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787579310.273968:0:8492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787579310.273978:0:8492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579310.273980:0:8492:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787579310.273985:0:8492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1787579310.274420:0:5863:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1787579310.274448:0:5863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787579310.274460:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79c00/0xb72beeaffa1b6d3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6d45 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579310.274474:0:5863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79c00/0xb72beeaffa1b6d3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6d45 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579310.274503:0:5863:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787579310.274506:0:5863:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0ce84eda800 from 39 10000000:01000000:0.0:1787579310.274509:0:5863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787579310.274558:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79800/0xb72beeaffa1b6d4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579310.274567:0:5863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79800/0xb72beeaffa1b6d4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579310.274577:0:5863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79800/0xb72beeaffa1b6d4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579310.274602:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616838912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787579310.274662:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579310.274794:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616838912 00000100:00100000:3.0:1787579310.274803:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616838912 00000100:00100000:3.0:1787579310.274865:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787579310.274875:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:5863:x1874412616838912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787579310.274890:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579310.274908:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce8152f200/0xb72beeaffa1b6d53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6d4c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579310.274968:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce8152f200/0xb72beeaffa1b6d53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6d4c expref: 15 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579310.274981:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce8152f200/0xb72beeaffa1b6d53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6d4c expref: 15 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579310.274991:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8152f200, rc 0) 00000100:00100000:0.0:1787579310.275173:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce878c13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787579310.279333:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:5863:x1874412616838912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 4435us (4646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579310.279372:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787579310.283500:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616838912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787579310.283539:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79800/0xb72beeaffa1b6d4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6d53 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579310.283568:0:5863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79800/0xb72beeaffa1b6d4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6d53 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579310.283673:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616839040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579310.283763:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579310.283866:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce878c13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787579310.284878:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616839040 00000100:00100000:1.0:1787579310.284891:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616839040 00000100:00100000:1.0:1787579310.285049:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787579310.285061:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91ddb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:5863:x1874412616839040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787579310.286456:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91ddb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:5863:x1874412616839040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1389us (2685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579310.286470:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787579310.286919:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616839040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579310.287019:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616839168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787579310.287092:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579310.287139:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce878c13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787579310.287271:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616839168 00000100:00100000:3.0:1787579310.287279:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616839168 00000100:00100000:3.0:1787579310.287343:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787579310.287353:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:5863:x1874412616839168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787579310.287562:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:5863:x1874412616839168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 210us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579310.287569:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787579310.287741:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616839168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787579310.288570:0:8493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8493:1874412616839296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787579310.288629:0:8493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579310.288670:0:8493:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce82d61cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787579310.289385:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616839296 00000100:00100000:3.0:1787579310.289395:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616839296 00000100:00100000:3.0:1787579310.289992:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787579310.290005:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:8493:x1874412616839296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787579310.290479:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:8493:x1874412616839296:12345-0@lo:502:llog_process_th.0 Request processed in 477us (1849us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579310.290489:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787579310.290617:0:8493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8493:1874412616839296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787579310.290691:0:8493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8493:1874412616839424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787579310.290752:0:8493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579310.294435:0:8493:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce82d61cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787579310.299840:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616839424 00000100:00100000:0.0:1787579310.299872:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616839424 00000100:00100000:0.0:1787579310.299961:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787579310.299974:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:8493:x1874412616839424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787579310.300362:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:8493:x1874412616839424:12345-0@lo:502:llog_process_th.0 Request processed in 389us (9608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579310.300373:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787579310.300517:0:8493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8493:1874412616839424:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787579310.300573:0:8493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787579310.300891:0:5863:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787579310.300915:0:5863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787579310.300960:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79800/0xb72beeaffa1b6d4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6d53 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579310.300972:0:5863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79800/0xb72beeaffa1b6d4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6d53 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579310.300982:0:5863:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787579310.300985:0:5863:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1787579310.300988:0:5863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787579310.301027:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79000/0xb72beeaffa1b6d5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579310.301036:0:5863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79000/0xb72beeaffa1b6d5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579310.301045:0:5863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79000/0xb72beeaffa1b6d5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579310.301080:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616839552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787579310.301132:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579310.301168:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce878c1600 going to sleep for 11 seconds 00000100:00100000:2.0:1787579310.301261:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616839552 00000100:00100000:2.0:1787579310.301267:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616839552 00000100:00100000:2.0:1787579310.301302:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787579310.301319:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91ddb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+15:5863:x1874412616839552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787579310.301332:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579310.301348:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6d61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6d5a expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579310.301377:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6d61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6d5a expref: 16 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579310.301387:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6d61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6d5a expref: 16 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579310.301397:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce813fda00, rc 0) 00000100:00100000:2.0:1787579310.301443:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91ddb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:5863:x1874412616839552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579310.301450:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787579310.301532:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616839552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787579310.301556:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79000/0xb72beeaffa1b6d5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6d61 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579310.301566:0:5863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79000/0xb72beeaffa1b6d5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6d61 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579310.301621:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616839680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579310.301647:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579310.301781:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce878c1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787579310.304139:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616839680 00000100:00100000:3.0:1787579310.304160:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616839680 00000100:00100000:1.0:1787579310.304910:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787579310.304946:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:5863:x1874412616839680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787579310.305354:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:5863:x1874412616839680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 430us (3704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579310.305363:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787579310.305500:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616839680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579310.305583:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616839808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787579310.305641:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579310.308353:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce878c1600 going to sleep for 11 seconds 00000100:00100000:2.0:1787579310.308425:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616839808 00000100:00100000:2.0:1787579310.308438:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616839808 00000100:00100000:2.0:1787579310.308527:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787579310.308538:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:5863:x1874412616839808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787579310.309101:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616839808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787579310.309432:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8494:1874412616839936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787579310.310137:0:8494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579310.310179:0:8494:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce878c1480 going to sleep for 11 seconds 00000100:00100000:3.0:1787579310.310234:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616839936 00000100:00100000:3.0:1787579310.310243:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616839936 00000100:00100000:3.0:1787579310.310287:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787579310.310298:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91ddbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:8494:x1874412616839936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787579310.310557:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91ddbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:8494:x1874412616839936:12345-0@lo:502:llog_process_th.0 Request processed in 251us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579310.310566:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787579310.310770:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8494:1874412616839936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787579310.310804:0:8494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787579310.310821:0:8494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579310.310823:0:8494:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787579310.310828:0:8494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787579310.311018:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8494:1874412616840064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787579310.311064:0:8494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579310.311085:0:8494:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce878c1480 going to sleep for 11 seconds 00000100:00100000:3.0:1787579310.311140:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616840064 00000100:00100000:3.0:1787579310.311146:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616840064 00000100:00100000:3.0:1787579310.311187:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787579310.311196:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91ddb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:8494:x1874412616840064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787579310.311345:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91ddb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:8494:x1874412616840064:12345-0@lo:502:llog_process_th.0 Request processed in 150us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579310.311353:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787579310.311459:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8494:1874412616840064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787579310.311481:0:8494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787579310.311487:0:8494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579310.311489:0:8494:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787579310.311493:0:8494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000100:00100000:2.0:1787579310.313183:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:5863:x1874412616839808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4637us (7533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579310.313198:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000020:01000000:1.0:1787579310.313432:0:5863:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787579310.313466:0:5863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787579310.313479:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79000/0xb72beeaffa1b6d5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6d61 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579310.313512:0:5863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79000/0xb72beeaffa1b6d5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6d61 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579310.313605:0:5863:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787579310.313610:0:5863:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0ce90be4800 from 39 10000000:01000000:0.0:1787579310.313613:0:5863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787579310.313657:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6d68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579310.313666:0:5863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6d68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579310.313678:0:5863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6d68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579310.313773:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616840192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787579310.313841:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579310.313981:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce878c1480 going to sleep for 11 seconds 00000100:00100000:3.0:1787579310.314185:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616840192 00000100:00100000:3.0:1787579310.314194:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616840192 00000100:00100000:3.0:1787579310.314284:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787579310.314295:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:5863:x1874412616840192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787579310.314312:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579310.314330:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce8152e800/0xb72beeaffa1b6d6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6d68 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579310.314358:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce8152e800/0xb72beeaffa1b6d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6d68 expref: 17 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579310.314370:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce8152e800/0xb72beeaffa1b6d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6d68 expref: 17 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579310.314380:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8152e800, rc 0) 00000100:00100000:3.0:1787579310.314436:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616840192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579310.314443:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787579310.314509:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616840192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787579310.314525:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6d68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6d6f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579310.314560:0:5863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6d68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6d6f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579310.314626:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616840320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579310.314656:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579310.323793:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce878c1480 going to sleep for 11 seconds 00000100:00100000:1.0:1787579310.324273:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616840320 00000100:00100000:1.0:1787579310.324287:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616840320 00000100:00100000:1.0:1787579310.324365:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787579310.324378:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616840320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787579310.325416:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616840320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1035us (10752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579310.325429:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787579310.325482:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616840320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579310.325571:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616840448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787579310.325633:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579310.325713:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce878c1480 going to sleep for 11 seconds 00000100:00100000:2.0:1787579310.325804:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616840448 00000100:00100000:2.0:1787579310.325811:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616840448 00000100:00100000:2.0:1787579310.325886:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787579310.325897:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616840448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787579310.326114:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616840448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 220us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579310.326128:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787579310.326234:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616840448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787579310.327421:0:8495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8495:1874412616840576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787579310.327650:0:8495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579310.327739:0:8495:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cebf3bd540 going to sleep for 11 seconds 00000100:00100000:0.0:1787579310.327782:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616840576 00000100:00100000:0.0:1787579310.327792:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616840576 00000100:00100000:0.0:1787579310.327844:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787579310.328372:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:8495:x1874412616840576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787579310.328883:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:8495:x1874412616840576:12345-0@lo:502:llog_process_th.0 Request processed in 583us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579310.328893:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787579310.329273:0:8495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8495:1874412616840576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787579310.329369:0:8495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8495:1874412616840704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787579310.329422:0:8495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579310.329504:0:8495:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cebf3bd540 going to sleep for 11 seconds 00000100:00100000:2.0:1787579310.333822:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616840704 00000100:00100000:2.0:1787579310.333843:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616840704 00000100:00100000:2.0:1787579310.333958:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787579310.333973:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:8495:x1874412616840704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787579310.334373:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:8495:x1874412616840704:12345-0@lo:502:llog_process_th.0 Request processed in 403us (4950us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579310.334382:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787579310.335128:0:8495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8495:1874412616840704:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787579310.335178:0:8495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787579310.335385:0:5863:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787579310.335411:0:5863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787579310.335424:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6d68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6d6f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579310.335436:0:5863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6d68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6d6f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579310.335447:0:5863:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787579310.335450:0:5863:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1787579310.335454:0:5863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787579310.335498:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79600/0xb72beeaffa1b6d76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579310.335522:0:5863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79600/0xb72beeaffa1b6d76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579310.335534:0:5863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79600/0xb72beeaffa1b6d76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579310.335575:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616840832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787579310.335635:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579310.335674:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce878c1600 going to sleep for 11 seconds 00000100:00100000:2.0:1787579310.336209:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616840832 00000100:00100000:2.0:1787579310.336220:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616840832 00000100:00100000:2.0:1787579310.336278:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787579310.336289:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616840832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787579310.336459:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579310.336477:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce813fc200/0xb72beeaffa1b6d7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6d76 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579310.336509:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce813fc200/0xb72beeaffa1b6d7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6d76 expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579310.336521:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce813fc200/0xb72beeaffa1b6d7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6d76 expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579310.336558:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce813fc200, rc 0) 00000100:00100000:2.0:1787579310.336625:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616840832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 337us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579310.336632:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787579310.336674:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616840832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787579310.336691:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79600/0xb72beeaffa1b6d76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6d7d expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579310.336702:0:5863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79600/0xb72beeaffa1b6d76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6d7d expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579310.336768:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616840960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579310.336801:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579310.336837:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce878c1600 going to sleep for 11 seconds 00000100:00100000:2.0:1787579310.336891:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616840960 00000100:00100000:2.0:1787579310.336896:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616840960 00000100:00100000:2.0:1787579310.336957:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787579310.336965:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616840960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787579310.337273:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616840960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 307us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579310.337281:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787579310.337513:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616840960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579310.337561:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616841088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787579310.337605:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579310.337633:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce878c1600 going to sleep for 11 seconds 00000100:00100000:2.0:1787579310.337680:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616841088 00000100:00100000:2.0:1787579310.337685:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616841088 00000100:00100000:2.0:1787579310.337728:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787579310.337736:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616841088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787579310.337903:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616841088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579310.337910:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787579310.338066:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616841088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787579310.338617:0:8496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8496:1874412616841216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787579310.338671:0:8496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579310.338715:0:8496:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce878c1300 going to sleep for 11 seconds 00000100:00100000:2.0:1787579310.338823:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616841216 00000100:00100000:2.0:1787579310.338828:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616841216 00000100:00100000:2.0:1787579310.338867:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787579310.338876:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:8496:x1874412616841216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787579310.339280:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:8496:x1874412616841216:12345-0@lo:502:llog_process_th.0 Request processed in 404us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579310.339289:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787579310.344333:0:8496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8496:1874412616841216:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787579310.344399:0:8496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787579310.344416:0:8496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579310.344418:0:8496:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787579310.344425:0:8496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787579310.344474:0:8496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8496:1874412616841344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787579310.344581:0:8496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579310.344632:0:8496:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce878c1300 going to sleep for 11 seconds 00000100:00100000:1.0:1787579310.344640:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616841344 00000100:00100000:1.0:1787579310.344649:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616841344 00000100:00100000:1.0:1787579310.344707:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787579310.344718:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:8496:x1874412616841344:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787579310.345073:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:8496:x1874412616841344:12345-0@lo:502:llog_process_th.0 Request processed in 355us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579310.345082:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787579310.345435:0:8496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8496:1874412616841344:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787579310.345461:0:8496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787579310.345469:0:8496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579310.345470:0:8496:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787579310.345474:0:8496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787579310.345651:0:5863:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1787579310.345672:0:5863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787579310.345684:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79600/0xb72beeaffa1b6d76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6d7d expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579310.345697:0:5863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79600/0xb72beeaffa1b6d76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6d7d expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579310.345710:0:5863:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787579310.345713:0:5863:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa0ce98720000 from 1 10000000:01000000:1.0:1787579310.345716:0:5863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787579310.345749:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b200/0xb72beeaffa1b6d84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579310.345758:0:5863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b200/0xb72beeaffa1b6d84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579310.345768:0:5863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b200/0xb72beeaffa1b6d84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579310.345786:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616841472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787579310.345830:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579310.345967:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616841472 00000100:00100000:2.0:1787579310.345974:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616841472 00000100:00100000:2.0:1787579310.346016:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787579310.346026:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616841472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787579310.346039:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579310.346054:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce813fc800/0xb72beeaffa1b6d8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6d84 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579310.346077:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce813fc800/0xb72beeaffa1b6d8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6d84 expref: 19 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579310.346087:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce813fc800/0xb72beeaffa1b6d8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6d84 expref: 19 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579310.346096:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce813fc800, rc 0) 00000100:00100000:2.0:1787579310.352141:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:5863:x1874412616841472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 6101us (6295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579310.352159:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787579310.355115:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cebf3bd240 going to sleep for 11 seconds 00000100:00100000:0.0:1787579310.355173:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616841472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787579310.355207:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b200/0xb72beeaffa1b6d84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6d8b expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579310.355222:0:5863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b200/0xb72beeaffa1b6d84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6d8b expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579310.355349:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616841600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579310.355420:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579310.355455:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce878c1300 going to sleep for 11 seconds 00000100:00100000:3.0:1787579310.355510:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616841600 00000100:00100000:3.0:1787579310.355519:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616841600 00000100:00100000:3.0:1787579310.355595:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787579310.355607:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:5863:x1874412616841600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787579310.356496:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:5863:x1874412616841600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 887us (1073us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787579310.356516:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787579310.356521:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616841600:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787579310.356593:0:5863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787579310.356603:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b200/0xb72beeaffa1b6d84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6d8b expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579310.356614:0:5863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b200/0xb72beeaffa1b6d84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6d8b expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579310.496577:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579311.520675:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579311.797609:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579311.797671:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579311.797714:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579311.797754:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579311.797795:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591649408 00000100:00100000:0.0:1787579311.797806:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591649408 00000100:00100000:0.0:1787579311.797871:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591649536 00000100:00100000:0.0:1787579311.797875:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591649536 00000100:00100000:0.0:1787579311.797899:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:0.0:1787579311.797912:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+5:2360:x1874412591649408:12345-192.168.206.53@tcp:400: 00000100:00100000:2.0:1787579311.797969:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591649152 00000100:00100000:2.0:1787579311.797975:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591649152 00000100:00100000:2.0:1787579311.798014:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 161 00000100:00100000:2.0:1787579311.798023:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+8:2360:x1874412591649152:12345-192.168.206.53@tcp:400: 00000100:00100000:2.0:1787579311.798129:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+8:2360:x1874412591649152:12345-192.168.206.53@tcp:400: Request processed in 106us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579311.798138:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 161 00000100:00100000:3.0:1787579311.798216:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591649280 00000100:00100000:3.0:1787579311.798222:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591649280 00000100:00100000:3.0:1787579311.798263:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 23 00000100:00100000:3.0:1787579311.798283:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+6:2360:x1874412591649280:12345-192.168.206.53@tcp:400: 00000100:00100000:2.0:1787579311.798312:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00100000:2.0:1787579311.798322:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+5:2360:x1874412591649536:12345-192.168.206.53@tcp:400: 00000100:00100000:3.0:1787579311.798345:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+6:2360:x1874412591649280:12345-192.168.206.53@tcp:400: Request processed in 63us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579311.798353:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 23 00000100:00100000:2.0:1787579311.798372:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+5:2360:x1874412591649536:12345-192.168.206.53@tcp:400: Request processed in 50us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579311.798381:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00080000:2.0:1787579311.798421:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787579311.798428:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787579311.798432:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787579311.798992:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+5:2360:x1874412591649408:12345-192.168.206.53@tcp:400: Request processed in 1080us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579311.799001:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 8 00010000:00010000:0.0:1787579312.544186:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579313.120601:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616841728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787579313.120700:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579313.120953:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616841728 00000100:00100000:0.0:1787579313.120963:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616841728 00000100:00100000:0.0:1787579313.121065:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787579313.121078:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616841728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787579313.121129:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787579313.121184:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787579313.121225:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616841856:0@lo:400:kworker.0 00000100:00100000:2.0:1787579313.121279:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579313.121331:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616841856 00000100:00100000:2.0:1787579313.121335:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616841856 00000100:00100000:2.0:1787579313.121365:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787579313.121373:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3320:x1874412616841856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579313.121417:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3320:x1874412616841856:12345-0@lo:400:kworker.0 Request processed in 45us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579313.121425:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787579313.121473:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616841856:0@lo:400:kworker.0 00000100:00100000:3.0:1787579313.126092:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3322:1874412616842112:0@lo:400:kworker.0 00000100:00100000:1.0:1787579313.126162:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3320:1874412616842368:0@lo:400:kworker.0 00000100:00100000:3.0:1787579313.126191:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579313.126288:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616841984:0@lo:400:kworker.0 00000100:00100000:1.0:1787579313.126877:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579313.126963:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787579313.126984:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616842240:0@lo:400:kworker.0 00000100:00100000:1.0:1787579313.127135:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579313.127176:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616842240 00000100:00100000:1.0:1787579313.127184:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616842240 00000100:00100000:1.0:1787579313.127241:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787579313.127251:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616842240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579313.127300:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616842240:12345-0@lo:400:kworker.0 Request processed in 51us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579313.127307:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1787579313.127388:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787579313.127462:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616842112 00000100:00100000:1.0:1787579313.127467:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616842112 00000100:00100000:1.0:1787579313.127571:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616842368 00000100:00100000:1.0:1787579313.127575:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616842368 00000100:00100000:1.0:1787579313.127593:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787579313.127599:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1874412616842112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579313.127635:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1874412616842112:12345-0@lo:400:kworker.0 Request processed in 36us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579313.127642:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787579313.127654:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787579313.127660:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874412616842368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579313.127689:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874412616842368:12345-0@lo:400:kworker.0 Request processed in 29us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579313.127719:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1787579313.127738:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787579313.127762:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec1a64700 x1874412616842240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579313.127789:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616842240:0@lo:400:kworker.0 00000100:00100000:1.0:1787579313.127802:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3320:1874412616842368:0@lo:400:kworker.0 00010000:00080000:1.0:1787579313.128751:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec119f100 x1874412616841728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579313.128771:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616841728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787579313.128827:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616841728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7752us (8126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579313.128846:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787579313.131197:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3322:1874412616842112:0@lo:400:kworker.0 00000100:00100000:2.0:1787579313.132131:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579313.132891:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616841984 00000100:00100000:1.0:1787579313.132905:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616841984 00000100:00100000:1.0:1787579313.133130:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787579313.133143:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616841984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579313.133372:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616841984:12345-0@lo:400:kworker.0 Request processed in 231us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579313.133381:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787579313.133570:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616841984:0@lo:400:kworker.0 00000100:00100000:3.0:1787579313.329014:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579313.329128:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591649664 00000100:00100000:0.0:1787579313.329142:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591649664 00000100:00100000:0.0:1787579313.329213:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 163 00000100:00100000:0.0:1787579313.329225:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+8:5603:x1874412591649664:12345-192.168.206.53@tcp:101: 00010000:00010000:0.0:1787579313.329246:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579313.329268:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceb3f78800/0xb72beeaffa1b6d92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01ce53 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579313.329302:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceb3f78800/0xb72beeaffa1b6d92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce53 expref: 9 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579313.329325:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceb3f78800/0xb72beeaffa1b6d92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce53 expref: 9 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579313.329337:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb3f78800, rc 0) 00000100:00100000:0.0:1787579313.329414:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+9:5603:x1874412591649664:12345-192.168.206.53@tcp:101: Request processed in 191us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579313.329421:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 163 00000100:00100000:1.0:1787579313.331813:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579313.331964:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591649792 00000100:00100000:2.0:1787579313.331975:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591649792 00000100:00100000:2.0:1787579313.332042:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 164 00000100:00100000:2.0:1787579313.332064:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+9:5603:x1874412591649792:12345-192.168.206.53@tcp:501: 00000100:00100000:2.0:1787579313.332596:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+9:5603:x1874412591649792:12345-192.168.206.53@tcp:501: Request processed in 533us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579313.332613:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 164 00000100:00100000:1.0:1787579313.335879:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579313.336031:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591649920 00000100:00100000:3.0:1787579313.336055:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591649920 00000100:00100000:3.0:1787579313.336124:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 165 00000100:00100000:3.0:1787579313.336135:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+9:5603:x1874412591649920:12345-192.168.206.53@tcp:503: 00000100:00100000:3.0:1787579313.336420:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+9:5603:x1874412591649920:12345-192.168.206.53@tcp:503: Request processed in 286us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579313.336429:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 165 00000100:00100000:3.0:1787579313.340359:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579313.340496:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591650048 00000100:00100000:2.0:1787579313.340509:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591650048 00000100:00100000:2.0:1787579313.340580:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 166 00000100:00100000:2.0:1787579313.340591:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+9:6088:x1874412591650048:12345-192.168.206.53@tcp:502: 00000100:00100000:2.0:1787579313.340986:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+9:6088:x1874412591650048:12345-192.168.206.53@tcp:502: Request processed in 395us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579313.340995:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 166 00000100:00100000:1.0:1787579313.343710:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579313.343816:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591650176 00000100:00100000:0.0:1787579313.343828:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591650176 00000100:00100000:0.0:1787579313.343894:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 167 00000100:00100000:0.0:1787579313.343906:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+9:6088:x1874412591650176:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787579313.344444:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+9:6088:x1874412591650176:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 537us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579313.344454:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 167 00000100:00100000:3.0:1787579313.347315:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579313.347423:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591650304 00000100:00100000:2.0:1787579313.347434:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591650304 00000100:00100000:2.0:1787579313.347508:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 168 00000100:00100000:2.0:1787579313.347520:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+9:5603:x1874412591650304:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787579313.347550:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579313.347574:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce813fcc00/0xb72beeaffa1b6d99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01ce5a expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579313.347610:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce813fcc00/0xb72beeaffa1b6d99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce5a expref: 10 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579313.347623:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce813fcc00/0xb72beeaffa1b6d99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce5a expref: 10 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579313.347633:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce813fcc00, rc 0) 00000100:00100000:2.0:1787579313.348722:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+10:5603:x1874412591650304:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 Request processed in 1196us (1419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579313.348733:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 168 00000100:00100000:3.0:1787579313.351016:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579313.351190:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591650432 00000100:00100000:1.0:1787579313.351202:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591650432 00000100:00100000:1.0:1787579313.351271:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 169 00000100:00100000:1.0:1787579313.351283:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+10:5603:x1874412591650432:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787579313.351773:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+10:5603:x1874412591650432:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 Request processed in 490us (768us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787579313.351784:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 169 00010000:00010000:1.0:1787579313.573407:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579313.632308:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616842496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787579313.632417:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579313.632571:0:7952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616842496 00000100:00100000:0.0:1787579313.632649:0:7952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616842496 00000100:00100000:0.0:1787579313.632711:0:7952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787579313.632720:0:7952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616842496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787579313.632974:0:7952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579313.633129:0:7952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616842496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 409us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579313.633137:0:7952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787579313.633331:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ce830ed500 x1874412616842496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579313.633356:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616842496:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1787579314.416701:0:8534:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff5172f4b0 20000000:00000080:0.0:1787579314.416726:0:8534:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0cebfb21400 uarg=0000000000000000 20000000:01000000:0.0:1787579314.416775:0:8534:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787579314.416783:0:8534:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787579314.416789:0:8534:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787579314.422004:0:8535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1787579314.422284:0:8534:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1787579314.427032:0:8534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1787579314.427857:0:8534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1787579314.427970:0:8534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1787579314.427994:0:8534:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787579314.428019:0:8534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6da0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579314.428040:0:8534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6b23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6b1c expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579314.428047:0:8534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ce80031800/0xb72beeaffa1b6b85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6b7e expref: 18 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579314.428054:0:8534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ce8148ac00/0xb72beeaffa1b6c73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6c6c expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579314.428063:0:8534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ceb3f79200/0xb72beeaffa1b6cff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce22 expref: 9 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579314.428070:0:8534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6da0 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579314.428136:0:8534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ceb3f79200/0xb72beeaffa1b6cff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce22 expref: 9 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579314.428173:0:8534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0ceb3f79200/0xb72beeaffa1b6cff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce22 expref: 9 pid: 5859 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579314.428200:0:8534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec119f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8534:1874412616842624:192.168.206.53@tcp:104: 00010000:00010000:3.0:1787579314.428424:0:8534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ce8148ac00/0xb72beeaffa1b6c73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b6c6c expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579314.428435:0:8534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0ce8148ac00/0xb72beeaffa1b6c73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b6c6c expref: 18 pid: 5860 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579314.428445:0:8534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a62d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8534:1874412616842752:0@lo:104: 00000100:00100000:3.0:1787579314.428499:0:8534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787579314.428556:0:8534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ce80031800/0xb72beeaffa1b6b85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b6b7e expref: 18 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579314.428565:0:8534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0ce80031800/0xb72beeaffa1b6b85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b6b7e expref: 18 pid: 5859 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579314.428573:0:8534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a61c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8534:1874412616842880:0@lo:104: 00010000:00010000:3.0:1787579314.428602:0:8534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6b23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b6b1c expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579314.428609:0:8534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6b23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b6b1c expref: 18 pid: 5861 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579314.428617:0:8534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a62300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8534:1874412616843008:0@lo:104: 00000100:00100000:3.0:1787579314.428637:0:8534:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cec1bcb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787579314.429147:0:5848:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787579314.429177:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579314.429212:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579314.429223:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616842752 00000100:00100000:0.0:1787579314.429231:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616842752 00000100:00100000:0.0:1787579314.429287:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616842880 00000100:00100000:0.0:1787579314.429291:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616842880 00000100:00100000:0.0:1787579314.429303:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616843008 00000100:00100000:0.0:1787579314.429306:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616843008 00000100:00100000:0.0:1787579314.429318:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787579314.429327:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1513850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+5:8534:x1874412616842752:12345-0@lo:104: 00010000:00010000:0.0:1787579314.429342:0:5848:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6c6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6c73 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579314.429410:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787579314.429417:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1513850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+5:8534:x1874412616842752:12345-0@lo:104: Request processed in 92us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579314.429436:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787579314.429479:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787579314.429486:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+4:8534:x1874412616842880:12345-0@lo:104: 00010000:00010000:0.0:1787579314.429494:0:5848:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ce813fca00/0xb72beeaffa1b6b7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6b85 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579314.429545:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787579314.429551:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+4:8534:x1874412616842880:12345-0@lo:104: Request processed in 66us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579314.429557:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787579314.429570:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787579314.429576:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+3:8534:x1874412616843008:12345-0@lo:104: 00010000:00010000:0.0:1787579314.429584:0:5848:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ce8148ba00/0xb72beeaffa1b6b1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6b23 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579314.429619:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787579314.429624:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+3:8534:x1874412616843008:12345-0@lo:104: Request processed in 49us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579314.429629:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1787579314.429647:0:8475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787579314.429653:0:8475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6c6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6c73 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579314.429660:0:8475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148bc00 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:0.0:1787579314.429665:0:8475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6c6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b6c73 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579314.429685:0:8475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6c6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b6c73 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787579314.429693:0:8475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6c6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b6c73 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579314.429699:0:8475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787579314.429735:0:8475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6c6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6c73 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579314.429742:0:8475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787579314.429765:0:8475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6c6c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6c73 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579314.429772:0:8475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6c6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6c73 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579314.429788:0:8475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787579314.429792:0:8475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce813fca00/0xb72beeaffa1b6b7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6b85 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579314.429798:0:8475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce813fca00 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:0.0:1787579314.429801:0:8475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce813fca00/0xb72beeaffa1b6b7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b6b85 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579314.429808:0:8475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce813fca00/0xb72beeaffa1b6b7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b6b85 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787579314.429814:0:8475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce813fca00/0xb72beeaffa1b6b7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b6b85 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579314.429826:0:8475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787579314.429841:0:8475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ce813fca00/0xb72beeaffa1b6b7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6b85 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579314.429848:0:8475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787579314.429866:0:8475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce813fca00/0xb72beeaffa1b6b7e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6b85 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579314.429873:0:8475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce813fca00/0xb72beeaffa1b6b7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6b85 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579314.429884:0:8475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787579314.429887:0:8475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce8148ba00/0xb72beeaffa1b6b1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6b23 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579314.429892:0:8475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148ba00 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:0.0:1787579314.429895:0:8475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8148ba00/0xb72beeaffa1b6b1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b6b23 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579314.429902:0:8475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce8148ba00/0xb72beeaffa1b6b1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b6b23 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787579314.429908:0:8475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8148ba00/0xb72beeaffa1b6b1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b6b23 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579314.429914:0:8475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787579314.429950:0:8475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ce8148ba00/0xb72beeaffa1b6b1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6b23 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579314.429956:0:8475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787579314.429969:0:8475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce8148ba00/0xb72beeaffa1b6b1c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6b23 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579314.429976:0:8475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce8148ba00/0xb72beeaffa1b6b1c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6b23 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579314.429990:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579314.429992:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579314.429994:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579314.430019:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616843136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787579314.430057:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579314.430099:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616843264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787579314.430124:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579314.430142:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787579314.430146:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616843392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787579314.430163:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579314.430194:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616843136 00000100:00100000:0.0:1787579314.430199:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616843136 00010000:00010000:0.0:1787579314.430217:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ce8148ac00/0xb72beeaffa1b6c73 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6c6c expref: 19 pid: 5860 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579314.430237:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616843264 00000100:00100000:0.0:1787579314.430241:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616843264 00010000:00010000:0.0:1787579314.430251:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ce80031800/0xb72beeaffa1b6b85 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6b7e expref: 20 pid: 5859 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579314.430262:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616843392 00000100:00100000:0.0:1787579314.430265:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616843392 00010000:00010000:0.0:1787579314.430274:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6b23 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6b1c expref: 21 pid: 5861 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579314.430301:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787579314.430307:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+21:3322:x1874412616843136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787579314.430319:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579314.430325:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ce8148ac00/0xb72beeaffa1b6c73 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6c6c expref: 21 pid: 5860 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579314.430335:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ce8148ac00/0xb72beeaffa1b6c73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b6c6c expref: 21 pid: 5860 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579314.430352:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579314.430382:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+21:3322:x1874412616843136:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579314.430389:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787579314.430403:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787579314.430408:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+20:3319:x1874412616843264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787579314.430416:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579314.430419:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ce80031800/0xb72beeaffa1b6b85 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6b7e expref: 20 pid: 5859 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579314.430427:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ce80031800/0xb72beeaffa1b6b85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b6b7e expref: 20 pid: 5859 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579314.430436:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579314.430461:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+20:3319:x1874412616843264:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579314.430467:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787579314.430479:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787579314.430492:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba315500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3319:x1874412616843392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787579314.430499:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579314.430503:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6b23 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6b1c expref: 19 pid: 5861 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579314.430511:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6b23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b6b1c expref: 19 pid: 5861 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579314.430521:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579314.430556:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba315500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3319:x1874412616843392:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579314.430561:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787579314.430605:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616843136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787579314.430633:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616843392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787579314.430641:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616843264:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787579314.430780:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579314.430858:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579314.431997:0:8534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce8148ac00/0xb72beeaffa1b6c73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b6c6c expref: 18 pid: 5860 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579314.432016:0:8534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a62d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8534:1874412616842752:0@lo:104: 00010000:00010000:3.0:1787579314.432027:0:8534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce80031800/0xb72beeaffa1b6b85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b6b7e expref: 17 pid: 5859 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579314.432051:0:8534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a61c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8534:1874412616842880:0@lo:104: 00010000:00010000:3.0:1787579314.432064:0:8534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6b23 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b6b1c expref: 16 pid: 5861 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579314.432072:0:8534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a62300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8534:1874412616843008:0@lo:104: 00000100:00100000:3.0:1787579314.435943:0:8534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec119f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8534:1874412616842624:192.168.206.53@tcp:104: 00010000:00010000:3.0:1787579314.436000:0:8534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6da0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579314.437493:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579314.437686:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591650560 00000100:00100000:3.0:1787579314.437699:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591650560 00010000:00010000:3.0:1787579314.437752:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ceb3f79200/0xb72beeaffa1b6cff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce22 expref: 10 pid: 5859 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579314.437842:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 24 00000100:00100000:3.0:1787579314.437854:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba314a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:803d6039-c137-4d52-85de-c5895e5f2411+10:2360:x1874412591650560:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787579314.437874:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579314.437881:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ceb3f79200/0xb72beeaffa1b6cff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce22 expref: 10 pid: 5859 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579314.437896:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ceb3f79200/0xb72beeaffa1b6cff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce22 expref: 10 pid: 5859 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579314.437919:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ceb3f79200/0xb72beeaffa1b6cff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce22 expref: 10 pid: 5859 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579314.437965:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6da0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579314.437990:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6da0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579314.438011:0:5851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6da0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579314.438019:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6da0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579314.438027:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6da0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579314.438034:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6da0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579314.438041:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce813fc400 already unused, calling callback (ffffffffc1654230) 00010000:00010000:3.0:1787579314.438045:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6da0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579314.438055:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6da0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579314.438208:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6da0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579314.438224:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579314.438416:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba314a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:803d6039-c137-4d52-85de-c5895e5f2411+9:2360:x1874412591650560:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 562us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579314.438426:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 24 00010000:00010000:1.0:1787579314.441992:0:8534:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6da0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579314.442017:0:8534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6da0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579314.442025:0:8534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6da0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579314.599895:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579314.770670:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579314.770765:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591650688 00000100:00100000:2.0:1787579314.770778:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591650688 00000100:00100000:2.0:1787579314.770850:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 170 00000100:00100000:2.0:1787579314.770862:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+9:5603:x1874412591650688:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787579314.770883:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579314.770907:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce813fca00/0xb72beeaffa1b6da7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01ce61 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579314.770980:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce813fca00/0xb72beeaffa1b6da7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce61 expref: 10 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579314.770993:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce813fca00/0xb72beeaffa1b6da7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce61 expref: 10 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579314.771004:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce813fca00, rc 0) 00000100:00100000:2.0:1787579314.771070:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+10:5603:x1874412591650688:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 Request processed in 210us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579314.771078:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 170 00000100:00100000:0.0:1787579314.773328:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579314.774607:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591650816 00000100:00100000:2.0:1787579314.774622:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591650816 00000100:00100000:2.0:1787579314.774699:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 171 00000100:00100000:2.0:1787579314.774712:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+10:5603:x1874412591650816:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787579314.775130:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+10:5603:x1874412591650816:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 Request processed in 419us (1812us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579314.775140:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 171 00000100:00100000:0.0:1787579314.779900:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579314.780055:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591650944 00000100:00100000:1.0:1787579314.780067:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591650944 00000100:00100000:1.0:1787579314.780143:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 172 00000100:00100000:1.0:1787579314.780155:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+10:5603:x1874412591650944:12345-192.168.206.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787579314.780468:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+10:5603:x1874412591650944:12345-192.168.206.53@tcp:503:ll_cfg_requeue.0 Request processed in 314us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579314.780478:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 172 00000100:00100000:0.0:1787579314.810076:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579314.810754:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591651072 00000100:00100000:3.0:1787579314.810784:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591651072 00000100:00100000:3.0:1787579314.810848:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 173 00000100:00100000:3.0:1787579314.810861:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+10:6138:x1874412591651072:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787579314.811189:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+10:6138:x1874412591651072:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 330us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579314.811199:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 173 00000100:00100000:0.0:1787579314.819051:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579314.819220:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591651200 00000100:00100000:2.0:1787579314.819232:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591651200 00000100:00100000:2.0:1787579314.819300:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 174 00000100:00100000:2.0:1787579314.819312:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+10:6138:x1874412591651200:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787579314.819626:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+10:6138:x1874412591651200:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 313us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579314.819635:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 174 00010000:00010000:0.0:1787579315.617465:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787579316.000668:0:5863:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787579316.000675:0:5863:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0ceb3138000 from 4 10000000:01000000:0.0:1787579316.000680:0:5863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787579316.000726:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f78e00/0xb72beeaffa1b6dae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579316.000754:0:5863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f78e00/0xb72beeaffa1b6dae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579316.000768:0:5863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f78e00/0xb72beeaffa1b6dae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579316.000791:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616843520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787579316.000854:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579316.000914:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9746ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787579316.001250:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616843520 00000100:00100000:2.0:1787579316.001264:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616843520 00000100:00100000:2.0:1787579316.001330:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787579316.001341:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:5863:x1874412616843520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787579316.001523:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579316.001545:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6db5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6dae expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579316.001576:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6db5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6dae expref: 17 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579316.001588:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6db5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6dae expref: 17 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579316.001600:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce813fde00, rc 0) 00000100:00100000:2.0:1787579316.001684:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616843520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 345us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579316.001707:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787579316.001852:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616843520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787579316.001871:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f78e00/0xb72beeaffa1b6dae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6db5 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579316.001882:0:5863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f78e00/0xb72beeaffa1b6dae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6db5 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579316.002549:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616843648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579316.002592:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579316.002629:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9746ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787579316.004073:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616843648 00000100:00100000:2.0:1787579316.004086:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616843648 00000100:00100000:2.0:1787579316.004257:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787579316.004267:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616843648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787579316.004794:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616843648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 528us (2200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579316.004803:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787579316.005252:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616843648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787579316.005318:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a65f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616843776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787579316.005399:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579316.005436:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce856226c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787579316.005502:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616843776 00000100:00100000:3.0:1787579316.005509:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616843776 00000100:00100000:3.0:1787579316.005651:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787579316.005663:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616843776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787579316.005860:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616843776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 199us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579316.005867:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787579316.005914:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a65f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616843776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787579316.006767:0:8602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8602:1874412616843904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787579316.006837:0:8602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579316.006876:0:8602:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce853579c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787579316.007237:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616843904 00000100:00100000:1.0:1787579316.007245:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616843904 00000100:00100000:1.0:1787579316.007284:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787579316.007294:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:8602:x1874412616843904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787579316.008037:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:8602:x1874412616843904:12345-0@lo:502:llog_process_th.0 Request processed in 742us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579316.008060:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787579316.013902:0:8602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8602:1874412616843904:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787579316.014003:0:8602:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787579316.014019:0:8602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579316.014022:0:8602:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787579316.014034:0:8602:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0ceb3138000 00000020:00000080:3.0:1787579316.014037:0:8602:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787579316.014165:0:8602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8602:1874412616844032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787579316.014252:0:8602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579316.014731:0:8602:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce853579c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787579316.014851:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616844032 00000100:00100000:0.0:1787579316.014860:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616844032 00000100:00100000:0.0:1787579316.014918:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787579316.014952:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:8602:x1874412616844032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787579316.015646:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:8602:x1874412616844032:12345-0@lo:502:llog_process_th.0 Request processed in 716us (1391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579316.015656:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787579316.025261:0:8602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8602:1874412616844032:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787579316.025548:0:8602:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787579316.025562:0:8602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787579316.025565:0:8602:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787579316.025574:0:8602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787579316.026541:0:5863:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787579316.026599:0:5863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787579316.026613:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f78e00/0xb72beeaffa1b6dae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6db5 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579316.026626:0:5863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f78e00/0xb72beeaffa1b6dae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6db5 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579316.026639:0:5863:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787579316.026642:0:5863:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0ce84eda800 from 4 10000000:01000000:3.0:1787579316.026645:0:5863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787579316.026685:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6dbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579316.026694:0:5863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6dbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579316.026705:0:5863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6dbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579316.026732:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a61c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616844160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787579316.026832:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579316.027820:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616844160 00000100:00100000:0.0:1787579316.027831:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616844160 00000100:00100000:0.0:1787579316.027896:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787579316.027906:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616844160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787579316.027921:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579316.027953:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceb3f78a00/0xb72beeaffa1b6dc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6dbc expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579316.027991:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceb3f78a00/0xb72beeaffa1b6dc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6dbc expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579316.028003:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceb3f78a00/0xb72beeaffa1b6dc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6dbc expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579316.028013:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb3f78a00, rc 0) 00000100:00100000:0.0:1787579316.028065:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616844160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579316.028072:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787579316.032065:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce853579c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787579316.032127:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a61c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616844160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787579316.032157:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6dbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6dc3 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579316.032171:0:5863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6dbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6dc3 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579316.032263:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616844288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579316.032344:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579316.032445:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9746af00 going to sleep for 11 seconds 00000100:00100000:3.0:1787579316.042145:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616844288 00000100:00100000:3.0:1787579316.042165:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616844288 00000100:00100000:2.0:1787579316.042682:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787579316.042692:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616844288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787579316.043340:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616844288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 646us (10992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579316.043349:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787579316.043507:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616844288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787579316.043580:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616844416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787579316.043630:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579316.043669:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce97767480 going to sleep for 11 seconds 00000100:00100000:2.0:1787579316.044277:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616844416 00000100:00100000:2.0:1787579316.044284:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616844416 00000100:00100000:2.0:1787579316.044315:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787579316.044323:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616844416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787579316.044649:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616844416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 326us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579316.044657:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787579316.055869:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616844416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787579316.061585:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8605:1874412616844544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787579316.062035:0:8605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579316.062098:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fe2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787579316.062235:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616844544 00000100:00100000:3.0:1787579316.062244:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616844544 00000100:00100000:3.0:1787579316.062310:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787579316.062322:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb1d50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:8605:x1874412616844544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787579316.062613:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb1d50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:8605:x1874412616844544:12345-0@lo:502:llog_process_th.0 Request processed in 293us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579316.062628:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787579316.063274:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8605:1874412616844544:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787579316.063316:0:8605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787579316.063328:0:8605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579316.063331:0:8605:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787579316.063339:0:8605:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0ce84eda800 00000020:00000080:1.0:1787579316.063342:0:8605:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787579316.063458:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a64700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8605:1874412616844672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787579316.063512:0:8605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579316.063562:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce97767480 going to sleep for 11 seconds 00000100:00100000:3.0:1787579316.063848:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616844672 00000100:00100000:3.0:1787579316.063856:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616844672 00000100:00100000:3.0:1787579316.063907:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787579316.063918:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb1d53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:8605:x1874412616844672:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787579316.064159:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb1d53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:8605:x1874412616844672:12345-0@lo:502:llog_process_th.0 Request processed in 242us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579316.064167:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787579316.064211:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a64700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8605:1874412616844672:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787579316.064233:0:8605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787579316.064238:0:8605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579316.064240:0:8605:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787579316.064249:0:8605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787579316.064826:0:5863:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787579316.064852:0:5863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787579316.064864:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6dbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6dc3 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579316.064878:0:5863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6dbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6dc3 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579316.064890:0:5863:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787579316.064894:0:5863:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0ce90be4800 from 4 10000000:01000000:1.0:1787579316.064896:0:5863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787579316.064950:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6dca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579316.064960:0:5863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6dca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579316.064971:0:5863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6dca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579316.064995:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616844800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787579316.065037:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579316.065070:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce97767240 going to sleep for 11 seconds 00000100:00100000:1.0:1787579316.065090:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616844800 00000100:00100000:1.0:1787579316.065095:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616844800 00000100:00100000:1.0:1787579316.065212:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787579316.065222:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb1d53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616844800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787579316.065234:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579316.065249:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce8148ac00/0xb72beeaffa1b6dd1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6dca expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579316.065276:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce8148ac00/0xb72beeaffa1b6dd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6dca expref: 19 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579316.065288:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce8148ac00/0xb72beeaffa1b6dd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6dca expref: 19 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579316.065299:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8148ac00, rc 0) 00000100:00100000:1.0:1787579316.065355:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb1d53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:5863:x1874412616844800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579316.065362:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787579316.065392:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616844800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787579316.065407:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6dca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6dd1 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579316.065418:0:5863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6dca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6dd1 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579316.065473:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616844928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579316.065503:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579316.065544:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616844928 00000100:00100000:1.0:1787579316.065549:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616844928 00000100:00100000:0.0:1787579316.065551:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fe2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787579316.065597:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787579316.065604:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce857d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:5863:x1874412616844928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787579316.065849:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce857d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:5863:x1874412616844928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579316.065856:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787579316.066504:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616844928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579316.066557:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616845056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787579316.066599:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579316.066629:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fe2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787579316.066917:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616845056 00000100:00100000:2.0:1787579316.066923:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616845056 00000100:00100000:2.0:1787579316.067238:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787579316.067248:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce857d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:5863:x1874412616845056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787579316.067463:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce857d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:5863:x1874412616845056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 216us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579316.067471:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787579316.067551:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616845056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787579316.070195:0:8606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a66300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8606:1874412616845184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787579316.070285:0:8606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579316.071985:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616845184 00000100:00100000:0.0:1787579316.072001:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616845184 00000100:00100000:1.0:1787579316.072031:0:8606:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce97767540 going to sleep for 11 seconds 00000100:00100000:0.0:1787579316.072067:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787579316.072079:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:8606:x1874412616845184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787579316.074088:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:8606:x1874412616845184:12345-0@lo:502:llog_process_th.0 Request processed in 1999us (3790us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579316.074102:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787579316.074683:0:8606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a66300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8606:1874412616845184:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787579316.074727:0:8606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787579316.074740:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579316.074743:0:8606:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787579316.074751:0:8606:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0ce90be4800 00000020:00000080:1.0:1787579316.074755:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787579316.074873:0:8606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a66300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8606:1874412616845312:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787579316.074957:0:8606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579316.074994:0:8606:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce97767540 going to sleep for 11 seconds 00000100:00100000:3.0:1787579316.075078:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616845312 00000100:00100000:3.0:1787579316.075086:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616845312 00000100:00100000:3.0:1787579316.075431:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787579316.075445:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84e09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:8606:x1874412616845312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787579316.075698:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84e09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:8606:x1874412616845312:12345-0@lo:502:llog_process_th.0 Request processed in 256us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579316.075707:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787579316.075812:0:8606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a66300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:8606:1874412616845312:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787579316.075843:0:8606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787579316.075852:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579316.075854:0:8606:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787579316.075861:0:8606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787579316.076343:0:5863:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787579316.076382:0:5863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787579316.076394:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6dca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6dd1 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579316.076407:0:5863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6dca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6dd1 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579316.640523:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579316.914957:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579316.915005:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579316.915031:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579316.915056:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579316.915092:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591651584 00000100:00100000:0.0:1787579316.915105:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591651584 00000100:00100000:0.0:1787579316.915171:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591651712 00000100:00100000:0.0:1787579316.915175:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591651712 00000100:00100000:0.0:1787579316.915200:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:0.0:1787579316.915211:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+5:2359:x1874412591651584:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579316.915299:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+5:2359:x1874412591651584:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 89us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579316.915308:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:0.0:1787579316.915329:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:0.0:1787579316.915336:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+5:2359:x1874412591651712:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579316.915362:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+5:2359:x1874412591651712:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 27us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579316.915369:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:1.0:1787579316.915636:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591651328 00000100:00100000:1.0:1787579316.915661:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591651328 00000100:00100000:1.0:1787579316.915706:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 190 00000100:00100000:1.0:1787579316.915713:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84e0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+10:2359:x1874412591651328:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579316.915754:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84e0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+10:2359:x1874412591651328:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 42us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579316.915761:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 190 00000100:00100000:1.0:1787579316.915800:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591651456 00000100:00100000:1.0:1787579316.915804:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591651456 00000100:00100000:1.0:1787579316.915836:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 27 00000100:00100000:1.0:1787579316.915843:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+6:2359:x1874412591651456:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579316.915873:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+6:2359:x1874412591651456:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 31us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579316.915881:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 27 00000100:00080000:1.0:1787579316.915898:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787579316.915904:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787579316.915906:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787579317.665631:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579318.242248:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616845568:0@lo:400:kworker.0 00000100:00100000:0.0:1787579318.242310:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579318.242353:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce87acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616846080:0@lo:400:kworker.0 00000100:00100000:0.0:1787579318.242377:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579318.242398:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787579318.242403:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616845440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787579318.242421:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579318.242434:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616845952:0@lo:400:kworker.0 00000100:00100000:0.0:1787579318.242450:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579318.242471:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1874412616845824:0@lo:400:kworker.0 00000100:00100000:0.0:1787579318.242493:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579318.242521:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787579318.242529:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874412616845696:0@lo:400:kworker.0 00000100:00100000:0.0:1787579318.242550:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579318.242565:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce87ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3320:1874412616846208:0@lo:400:kworker.0 00000100:00100000:0.0:1787579318.242583:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579318.242609:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616846080 00000100:00100000:0.0:1787579318.242615:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616846080 00000100:00100000:0.0:1787579318.242655:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616845952 00000100:00100000:0.0:1787579318.242658:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616845952 00000100:00100000:3.0:1787579318.242787:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616845568 00000100:00100000:3.0:1787579318.242791:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616845568 00000100:00100000:3.0:1787579318.242824:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787579318.242832:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3322:x1874412616845568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579318.242881:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3322:x1874412616845568:12345-0@lo:400:kworker.0 Request processed in 50us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579318.242898:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787579318.242943:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616845824 00000100:00100000:3.0:1787579318.242946:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616845824 00000100:00100000:3.0:1787579318.242963:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616845696 00000100:00100000:3.0:1787579318.242965:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616845696 00000100:00100000:3.0:1787579318.242973:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616846208 00000100:00100000:3.0:1787579318.242975:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616846208 00000100:00100000:3.0:1787579318.242986:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787579318.242992:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874412616845824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579318.243024:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874412616845824:12345-0@lo:400:kworker.0 Request processed in 32us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579318.243030:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787579318.243040:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787579318.243045:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874412616845696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579318.243066:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874412616845696:12345-0@lo:400:kworker.0 Request processed in 21us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579318.243070:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787579318.243080:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787579318.243084:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874412616846208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579318.243103:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874412616846208:12345-0@lo:400:kworker.0 Request processed in 19us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579318.243108:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787579318.243139:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874412616845696:0@lo:400:kworker.0 00000100:00100000:3.0:1787579318.243148:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce87ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3320:1874412616846208:0@lo:400:kworker.0 00000100:00100000:3.0:1787579318.243156:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1874412616845824:0@lo:400:kworker.0 00000100:00100000:3.0:1787579318.243194:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616845568:0@lo:400:kworker.0 00000100:00100000:0.0:1787579318.243310:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787579318.243318:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616846080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579318.243355:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616846080:12345-0@lo:400:kworker.0 Request processed in 38us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579318.243361:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787579318.243372:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787579318.243378:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616845952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579318.243398:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616845952:12345-0@lo:400:kworker.0 Request processed in 21us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579318.243409:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787579318.243425:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616845440 00000100:00100000:0.0:1787579318.243429:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616845440 00000100:00100000:0.0:1787579318.243449:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787579318.243455:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616845440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787579318.243478:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579318.243518:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616845440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579318.243524:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787579318.243548:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787579318.243552:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787579318.243554:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787579318.243648:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec1a66300 x1874412616845440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579318.243662:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616845440:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787579318.243671:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ce830edf80 x1874412616845952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579318.243680:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616845952:0@lo:400:kworker.0 00010000:00080000:3.0:1787579318.243688:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ce87acb480 x1874412616846080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579318.243695:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce87acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616846080:0@lo:400:kworker.0 00010000:00010000:3.0:1787579318.691498:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579318.752185:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787579318.752206:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce87acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616846336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787579318.752267:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579318.752360:0:7952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616846336 00000100:00100000:0.0:1787579318.752368:0:7952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616846336 00000100:00100000:0.0:1787579318.752425:0:7952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787579318.752434:0:7952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616846336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787579318.752464:0:7952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579318.752518:0:7952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616846336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579318.752526:0:7952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1787579318.752683:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ce87acbb80 x1874412616846336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579318.752701:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce87acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616846336:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787579319.712212:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579320.741612:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787579321.209552:0:8834:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg653-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1787579321.764435:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579322.037589:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579322.037637:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579322.037677:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579322.037713:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579322.037723:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591652096 00000100:00100000:3.0:1787579322.037733:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591652096 00000100:00100000:1.0:1787579322.037739:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591651968 00000100:00100000:1.0:1787579322.037746:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591651968 00000100:00100000:2.0:1787579322.037781:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591651840 00000100:00100000:2.0:1787579322.037788:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591651840 00000100:00100000:3.0:1787579322.037805:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591652224 00000100:00100000:3.0:1787579322.037811:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591652224 00000100:00100000:1.0:1787579322.037811:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 31 00000100:00100000:1.0:1787579322.037827:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+6:2359:x1874412591651968:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1787579322.037832:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 192 00000100:00100000:2.0:1787579322.037845:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce85749850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+10:2359:x1874412591651840:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1787579322.037850:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 15 00000100:00100000:3.0:1787579322.037862:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+5:2359:x1874412591652096:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579322.037914:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+6:2359:x1874412591651968:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 92us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579322.037922:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 31 00000100:00100000:1.0:1787579322.037991:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00100000:1.0:1787579322.038000:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+5:2359:x1874412591652224:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1787579322.038476:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce85749850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+10:2359:x1874412591651840:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 634us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579322.038497:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+5:2359:x1874412591652096:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 623us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579322.038498:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 192 00000100:00100000:3.0:1787579322.038511:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 15 00000100:00080000:3.0:1787579322.038534:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787579322.038538:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787579322.038540:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787579322.038774:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+5:2359:x1874412591652224:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 774us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579322.038781:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 16 00010000:00010000:3.0:1787579322.784233:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579323.362257:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616846464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787579323.362326:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579323.362442:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616846464 00000100:00100000:1.0:1787579323.362449:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616846464 00000100:00100000:1.0:1787579323.362522:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787579323.362533:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616846464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787579323.362566:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787579323.362608:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616846464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579323.362615:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1787579323.362670:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787579323.362697:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec1a64700 x1874412616846464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579323.362716:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616846464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787579323.366384:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616846976:0@lo:400:kworker.0 00000100:00100000:1.0:1787579323.366447:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579323.366494:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787579323.366500:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616846592:0@lo:400:kworker.0 00000100:00100000:1.0:1787579323.366527:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579323.366550:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1874412616847104:0@lo:400:kworker.0 00000100:00100000:1.0:1787579323.366572:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579323.366598:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616846720:0@lo:400:kworker.0 00000100:00100000:1.0:1787579323.366619:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579323.366636:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787579323.366641:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616846848:0@lo:400:kworker.0 00000100:00100000:1.0:1787579323.366666:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579323.366707:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616846976 00000100:00100000:1.0:1787579323.366714:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616846976 00000100:00100000:1.0:1787579323.366767:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787579323.366776:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616846976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579323.366825:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616846976:12345-0@lo:400:kworker.0 Request processed in 50us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579323.366832:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787579323.366854:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616846592 00000100:00100000:1.0:1787579323.366858:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616846592 00000100:00100000:1.0:1787579323.366881:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787579323.366888:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce85749050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3321:x1874412616846592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579323.368246:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce85749050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3321:x1874412616846592:12345-0@lo:400:kworker.0 Request processed in 29us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579323.368260:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787579323.368317:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616847104 00000100:00100000:1.0:1787579323.368323:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616847104 00000100:00100000:1.0:1787579323.368352:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616846720 00000100:00100000:1.0:1787579323.368355:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616846720 00000100:00100000:1.0:1787579323.368366:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616846848 00000100:00100000:1.0:1787579323.368369:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616846848 00000100:00100000:1.0:1787579323.368387:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787579323.368395:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874412616847104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579323.368458:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874412616847104:12345-0@lo:400:kworker.0 Request processed in 64us (1884us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579323.368464:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787579323.368490:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787579323.368497:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616846720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579323.368534:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616846720:12345-0@lo:400:kworker.0 Request processed in 38us (1913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579323.368547:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787579323.368561:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787579323.368567:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616846848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579323.368596:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616846848:12345-0@lo:400:kworker.0 Request processed in 30us (1929us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579323.368602:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1787579323.368627:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787579323.368630:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787579323.368668:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616846848:0@lo:400:kworker.0 00000100:00100000:1.0:1787579323.368681:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616846720:0@lo:400:kworker.0 00000100:00100000:1.0:1787579323.368718:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616846592:0@lo:400:kworker.0 00000100:00100000:1.0:1787579323.368729:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1874412616847104:0@lo:400:kworker.0 00010000:00080000:1.0:1787579323.368742:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec1a64000 x1874412616846976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579323.368752:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616846976:0@lo:400:kworker.0 00010000:00010000:2.0:1787579323.811090:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579323.874130:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787579323.874154:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616847232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787579323.874218:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579323.874490:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616847232 00000100:00100000:2.0:1787579323.874498:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616847232 00000100:00100000:2.0:1787579323.874767:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787579323.874786:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616847232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787579323.874819:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579323.874879:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616847232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579323.874886:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1787579323.875023:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec1a64000 x1874412616847232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579323.875040:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616847232:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787579324.835959:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579325.860836:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787579326.266847:0:9078:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg653-server.virtnet: executing yml_node 00010000:00010000:0.0:1787579326.880026:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579327.166664:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579327.166743:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579327.167340:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591652480 00000100:00100000:1.0:1787579327.167351:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591652480 00000100:00100000:1.0:1787579327.167418:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 35 00000100:00100000:1.0:1787579327.167428:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+6:2359:x1874412591652480:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579327.167514:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+6:2359:x1874412591652480:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 87us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579327.167521:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 35 00000100:00080000:2.0:1787579327.168660:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787579327.170998:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591652352 00000100:00100000:3.0:1787579327.171010:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591652352 00000100:00100000:3.0:1787579327.171062:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 194 00000100:00100000:3.0:1787579327.171072:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8574b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+10:2359:x1874412591652352:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1787579327.171157:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8574b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+10:2359:x1874412591652352:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 86us (4503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579327.171175:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 194 00000100:00100000:3.0:1787579327.173220:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579327.173263:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579327.173293:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591652608 00000100:00100000:3.0:1787579327.173300:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591652608 00000100:00100000:3.0:1787579327.173347:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591652736 00000100:00100000:3.0:1787579327.173362:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591652736 00000100:00100000:3.0:1787579327.173390:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:3.0:1787579327.173400:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+5:2358:x1874412591652608:12345-192.168.206.53@tcp:9:kworker.0 00000020:00000080:3.0:1787579327.173431:0:7660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6d0d 00000100:00080000:3.0:1787579327.173440:0:7660:0:(import.c:65:import_set_state_nolock()) ffffa0ceb3e12800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787579327.173489:0:7660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787579327.174243:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+2:2358:x1874412591652608:12345-192.168.206.53@tcp:9:kworker.0 Request processed in 842us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579327.174253:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:3.0:1787579327.174274:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:3.0:1787579327.174283:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+5:2358:x1874412591652736:12345-192.168.206.53@tcp:9:kworker.0 00000020:00000080:3.0:1787579327.174300:0:7660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6d14 00000100:00080000:3.0:1787579327.174307:0:7660:0:(import.c:65:import_set_state_nolock()) ffffa0cebf258000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787579327.174340:0:7660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787579327.174565:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+2:2358:x1874412591652736:12345-192.168.206.53@tcp:9:kworker.0 Request processed in 283us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579327.174584:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 12 00010000:00010000:3.0:1787579327.174660:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787579327.174667:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787579327.174670:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787579327.174855:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579327.904172:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579328.481831:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616847488:0@lo:400:kworker.0 00000100:00100000:1.0:1787579328.481894:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579328.481975:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1874412616848000:0@lo:400:kworker.0 00000100:00100000:1.0:1787579328.481998:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579328.482028:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787579328.482034:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616847616:0@lo:400:kworker.0 00000100:00100000:1.0:1787579328.482056:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579328.482072:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616848128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787579328.482096:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579328.482129:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616847488 00000100:00100000:1.0:1787579328.482136:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616847488 00000100:00100000:1.0:1787579328.482186:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616848000 00000100:00100000:1.0:1787579328.482190:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616848000 00000100:00100000:1.0:1787579328.482213:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616847616 00000100:00100000:1.0:1787579328.482216:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616847616 00000100:00100000:1.0:1787579328.482231:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787579328.482238:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616847488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579328.482287:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616847488:12345-0@lo:400:kworker.0 Request processed in 49us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579328.482294:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787579328.482309:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787579328.482315:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874412616848000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579328.482342:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874412616848000:12345-0@lo:400:kworker.0 Request processed in 28us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579328.482349:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787579328.482359:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787579328.482365:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616847616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579328.482404:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616847616:12345-0@lo:400:kworker.0 Request processed in 39us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579328.482410:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787579328.482432:0:7952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616848128 00000100:00100000:1.0:1787579328.482435:0:7952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616848128 00000100:00100000:1.0:1787579328.482473:0:7952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787579328.482480:0:7952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616848128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787579328.482506:0:7952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787579328.482538:0:7952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616848128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579328.482543:0:7952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787579328.482558:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787579328.482562:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579328.482590:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616847616:0@lo:400:kworker.0 00010000:00080000:1.0:1787579328.482601:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec1a66a00 x1874412616848128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579328.482620:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616848128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787579328.482631:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616847488:0@lo:400:kworker.0 00000100:00100000:1.0:1787579328.482637:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1874412616848000:0@lo:400:kworker.0 00000100:00100000:2.0:1787579328.484364:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616847744:0@lo:400:kworker.0 00000100:00100000:2.0:1787579328.484426:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579328.484479:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787579328.484486:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616847360:0@lo:400:kworker.0 00000100:00100000:2.0:1787579328.484513:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579328.484547:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616847872:0@lo:400:kworker.0 00000100:00100000:2.0:1787579328.484569:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579328.484604:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616847744 00000100:00100000:2.0:1787579328.484610:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616847744 00000100:00100000:2.0:1787579328.484650:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616847872 00000100:00100000:2.0:1787579328.484654:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616847872 00000100:00100000:2.0:1787579328.484674:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787579328.484681:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616847744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579328.484726:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616847744:12345-0@lo:400:kworker.0 Request processed in 45us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579328.484733:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787579328.484748:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787579328.484754:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616847872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579328.484794:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616847872:12345-0@lo:400:kworker.0 Request processed in 41us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579328.484801:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1787579328.484837:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec1a62300 x1874412616847872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579328.484848:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616847872:0@lo:400:kworker.0 00010000:00080000:2.0:1787579328.484859:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec1a61c00 x1874412616847744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579328.484867:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616847744:0@lo:400:kworker.0 00000100:00100000:1.0:1787579328.485168:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616847360 00000100:00100000:1.0:1787579328.485174:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616847360 00000100:00100000:1.0:1787579328.485208:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787579328.485216:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce85748c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3319:x1874412616847360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579328.485261:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce85748c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3319:x1874412616847360:12345-0@lo:400:kworker.0 Request processed in 46us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579328.485274:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:1.0:1787579328.485303:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787579328.485548:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616847360:0@lo:400:kworker.0 00010000:00010000:0.0:1787579328.928060:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579328.992205:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616848256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787579328.992269:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579328.992384:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616848256 00000100:00100000:1.0:1787579328.992391:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616848256 00000100:00100000:1.0:1787579328.992452:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787579328.992462:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616848256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787579328.992493:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787579328.992542:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616848256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579328.992549:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1787579328.992627:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec1a66a00 x1874412616848256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579328.992644:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616848256:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787579329.957616:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787579330.457293:0:9269:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.80 00000001:00100000:3.0:1787579330.594740:0:7670:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 963d8c17-1326-491b-be60-9002b9296555 00000020:00000080:3.0:1787579330.594762:0:7670:0:(genops.c:885:class_export_put()) final put ffffa0cebf25c800/963d8c17-1326-491b-be60-9002b9296555 00000020:00000080:3.0:1787579330.594792:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0cebf25c800/963d8c17-1326-491b-be60-9002b9296555 for lustre-OST0001 00000020:00000080:3.0:1787579330.594833:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0cebf258000 for lustre-OST0001 00010000:00010000:2.0:1787579330.979481:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787579331.584664:0:6735:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 963d8c17-1326-491b-be60-9002b9296555 00000020:00000080:1.0:1787579331.584673:0:6735:0:(genops.c:885:class_export_put()) final put ffffa0ceb3e14000/963d8c17-1326-491b-be60-9002b9296555 00000020:00000080:3.0:1787579331.584747:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ceb3e14000/963d8c17-1326-491b-be60-9002b9296555 for lustre-OST0000 00000020:00000080:3.0:1787579331.584799:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0ceb3e12800 for lustre-OST0000 00010000:00010000:2.0:1787579332.004946:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579332.281865:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579332.282225:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579332.288811:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591652992 00000100:00100000:0.0:1787579332.288841:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591652992 00000100:00100000:0.0:1787579332.288978:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 39 00000100:00100000:0.0:1787579332.288990:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+6:2360:x1874412591652992:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579332.289072:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+6:2360:x1874412591652992:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 84us (7216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579332.289080:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 39 00000100:00100000:3.0:1787579332.291284:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591652864 00000100:00100000:3.0:1787579332.291297:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591652864 00000100:00100000:3.0:1787579332.291393:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 196 00000100:00100000:3.0:1787579332.291403:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce85749450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+10:2360:x1874412591652864:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1787579332.291528:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce85749450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+10:2360:x1874412591652864:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 127us (9303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579332.291535:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 196 00000100:00080000:2.0:1787579332.298649:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1787579332.896771:0:9368:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.80 00010000:00010000:0.0:1787579333.024174:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579333.602691:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616848384:0@lo:400:kworker.0 00000100:00100000:0.0:1787579333.602754:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579333.604768:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616848384 00000100:00100000:3.0:1787579333.604782:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616848384 00000100:00100000:3.0:1787579333.604835:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787579333.604845:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8574bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3320:x1874412616848384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579333.609256:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8574bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3320:x1874412616848384:12345-0@lo:400:kworker.0 Request processed in 4403us (6492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579333.609270:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787579333.609554:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616848768:0@lo:400:kworker.0 00000100:00100000:1.0:1787579333.609613:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579333.609652:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787579333.609658:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616848896:0@lo:400:kworker.0 00000100:00100000:1.0:1787579333.609680:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579333.609710:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616848512:0@lo:400:kworker.0 00000100:00100000:1.0:1787579333.609732:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579333.609749:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1874412616849024:0@lo:400:kworker.0 00000100:00100000:1.0:1787579333.609766:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579333.609783:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787579333.609788:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616848640:0@lo:400:kworker.0 00000100:00100000:1.0:1787579333.609806:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579333.609822:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616849152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787579333.609850:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579333.609877:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616848768 00000100:00100000:1.0:1787579333.609883:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616848768 00000100:00100000:1.0:1787579333.609922:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616848896 00000100:00100000:1.0:1787579333.609944:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616848896 00000100:00100000:1.0:1787579333.609964:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787579333.609971:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616848768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579333.610013:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616848768:12345-0@lo:400:kworker.0 Request processed in 41us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579333.610019:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787579333.610031:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787579333.610037:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616848896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579333.610061:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616848896:12345-0@lo:400:kworker.0 Request processed in 24us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579333.610067:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787579333.610081:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616848512 00000100:00100000:1.0:1787579333.610084:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616848512 00000100:00100000:1.0:1787579333.610099:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616849024 00000100:00100000:1.0:1787579333.610102:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616849024 00000100:00100000:1.0:1787579333.610118:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616848640 00000100:00100000:1.0:1787579333.610120:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616848640 00000100:00100000:1.0:1787579333.610133:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787579333.610138:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616848512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579333.610173:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616848512:12345-0@lo:400:kworker.0 Request processed in 34us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579333.610179:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787579333.610321:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787579333.610329:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874412616849024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579333.610445:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874412616849024:12345-0@lo:400:kworker.0 Request processed in 116us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579333.610451:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787579333.610464:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787579333.610469:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616848640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579333.610496:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616848640:12345-0@lo:400:kworker.0 Request processed in 27us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579333.610501:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787579333.610524:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616849152 00000100:00100000:1.0:1787579333.610527:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616849152 00000100:00100000:1.0:1787579333.610549:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787579333.610555:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616849152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787579333.610580:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787579333.611117:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616849152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 561us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579333.611125:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1787579333.611143:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787579333.611148:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787579333.611149:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787579333.611181:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceba830380 x1874412616848896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579333.611256:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616848896:0@lo:400:kworker.0 00010000:00080000:1.0:1787579333.611271:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceba831880 x1874412616848768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579333.611280:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616848768:0@lo:400:kworker.0 00000100:00100000:1.0:1787579333.611324:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616848640:0@lo:400:kworker.0 00010000:00080000:1.0:1787579333.611334:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceba830000 x1874412616849152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579333.611347:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616849152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787579333.611677:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616848512:0@lo:400:kworker.0 00000100:00100000:1.0:1787579333.611689:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1874412616849024:0@lo:400:kworker.0 00000100:00100000:0.0:1787579333.613335:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616848384:0@lo:400:kworker.0 00010000:00010000:3.0:1787579334.055205:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579334.117536:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787579334.117558:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616849280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787579334.117621:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579334.117682:0:7952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616849280 00000100:00100000:1.0:1787579334.117701:0:7952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616849280 00000100:00100000:1.0:1787579334.117743:0:7952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787579334.117751:0:7952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616849280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787579334.117781:0:7952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787579334.117825:0:7952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616849280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579334.117833:0:7952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1787579334.117873:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceba833480 x1874412616849280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579334.117891:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616849280:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787579335.079875:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787579335.842560:0:9465:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.80 00010000:00010000:2.0:1787579336.096208:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579337.120386:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579337.393209:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579337.393268:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579337.394152:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591653248 00000100:00100000:3.0:1787579337.394165:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591653248 00000100:00100000:3.0:1787579337.394234:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 43 00000100:00100000:3.0:1787579337.394245:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb468ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+6:2361:x1874412591653248:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1787579337.394331:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb468ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+6:2361:x1874412591653248:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 87us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579337.394338:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 43 00000100:00080000:2.0:1787579337.394561:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579337.394623:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591653120 00000100:00100000:1.0:1787579337.394628:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591653120 00000100:00100000:1.0:1787579337.394659:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 198 00000100:00100000:1.0:1787579337.394666:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91ddac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+10:2362:x1874412591653120:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579337.394716:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91ddac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+10:2362:x1874412591653120:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 51us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579337.394723:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 198 00000001:02000400:3.0:1787579337.927706:0:9513:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Aug 24 09:48:55 EDT 2026 00010000:00010000:3.0:1787579338.156364:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579338.722030:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616849792:0@lo:400:kworker.0 00000100:00100000:3.0:1787579338.722093:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579338.722149:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787579338.722156:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616849408:0@lo:400:kworker.0 00000100:00100000:3.0:1787579338.722183:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579338.722204:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616849920:0@lo:400:kworker.0 00000100:00100000:3.0:1787579338.722225:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579338.722252:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616849536:0@lo:400:kworker.0 00000100:00100000:3.0:1787579338.722275:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579338.722293:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1874412616850048:0@lo:400:kworker.0 00000100:00100000:3.0:1787579338.722312:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579338.722333:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787579338.722338:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616849664:0@lo:400:kworker.0 00000100:00100000:3.0:1787579338.722357:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579338.722384:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616849792 00000100:00100000:3.0:1787579338.722401:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616849792 00000100:00100000:3.0:1787579338.722447:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616849920 00000100:00100000:3.0:1787579338.722450:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616849920 00000100:00100000:3.0:1787579338.722470:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787579338.722477:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616849792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579338.722532:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616849792:12345-0@lo:400:kworker.0 Request processed in 55us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579338.722540:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787579338.722555:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787579338.722560:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616849920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579338.722585:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616849920:12345-0@lo:400:kworker.0 Request processed in 25us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579338.722590:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787579338.722607:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616849408 00000100:00100000:3.0:1787579338.722610:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616849408 00000100:00100000:3.0:1787579338.722633:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787579338.722638:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3319:x1874412616849408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579338.722665:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3319:x1874412616849408:12345-0@lo:400:kworker.0 Request processed in 26us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579338.722670:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787579338.722697:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616849536 00000100:00100000:3.0:1787579338.722700:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616849536 00000100:00100000:3.0:1787579338.722716:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616850048 00000100:00100000:3.0:1787579338.722719:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616850048 00000100:00100000:3.0:1787579338.722730:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616849664 00000100:00100000:3.0:1787579338.722732:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616849664 00000100:00100000:3.0:1787579338.722745:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787579338.722750:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616849536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579338.722979:0:5867:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787579338.722981:0:5868:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787579338.722987:0:5867:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787579338.722990:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787579338.722998:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874412616850048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579338.724297:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616849408:0@lo:400:kworker.0 00010000:00080000:0.0:1787579338.724315:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec1a60700 x1874412616849920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579338.724327:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616849920:0@lo:400:kworker.0 00010000:00080000:0.0:1787579338.724337:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec1a62300 x1874412616849792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579338.724344:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616849792:0@lo:400:kworker.0 00000100:00080000:2.0:1787579338.724506:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787579338.724511:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787579338.724514:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787579338.724523:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787579338.724534:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616850176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787579338.730272:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579338.730464:0:9530:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1787579338.730474:0:9530:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1787579338.730550:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787579338.730562:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616849664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579338.730618:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616849664:12345-0@lo:400:kworker.0 Request processed in 60us (8259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579338.730626:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787579338.730667:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616849664:0@lo:400:kworker.0 00000100:00100000:3.0:1787579338.733281:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616849536:12345-0@lo:400:kworker.0 Request processed in 10521us (10995us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579338.733296:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787579338.733414:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616849536:0@lo:400:kworker.0 00000100:00100000:0.0:1787579338.737026:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874412616850048:12345-0@lo:400:kworker.0 Request processed in 14020us (14703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579338.737038:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787579338.737088:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616850176 00000100:00100000:0.0:1787579338.737107:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616850176 00000100:00100000:0.0:1787579338.737148:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787579338.737155:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb468a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616850176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787579338.737200:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579338.737246:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb468a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616850176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (6979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579338.737252:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1787579338.747694:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceb4689c00 x1874412616850176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579338.747721:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616850176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787579338.747739:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1874412616850048:0@lo:400:kworker.0 00010000:00010000:2.0:1787579339.168822:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579339.232454:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616850304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787579339.232534:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579339.232819:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616850304 00000100:00100000:2.0:1787579339.232826:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616850304 00000100:00100000:2.0:1787579339.232877:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787579339.232886:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616850304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787579339.232918:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579339.232992:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616850304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579339.233000:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1787579339.233144:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceb4689c00 x1874412616850304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579339.233174:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616850304:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787579340.192303:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579341.216138:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579342.240467:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579342.513414:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579342.513453:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579342.513624:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591653376 00000100:00100000:1.0:1787579342.513633:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591653376 00000100:00100000:1.0:1787579342.513671:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 200 00000100:00100000:1.0:1787579342.513679:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+10:2361:x1874412591653376:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579342.513731:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+10:2361:x1874412591653376:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 53us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579342.513738:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 200 00000100:00100000:0.0:1787579342.513891:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591653504 00000100:00100000:0.0:1787579342.513895:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591653504 00000100:00100000:0.0:1787579342.513955:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 47 00000100:00100000:0.0:1787579342.513962:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+6:2361:x1874412591653504:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579342.513992:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+6:2361:x1874412591653504:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 31us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579342.513999:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 47 00000100:00080000:1.0:1787579342.514062:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787579343.275008:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579343.846455:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787579343.846476:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616850432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787579343.846547:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579343.846605:0:7952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616850432 00000100:00100000:3.0:1787579343.846612:0:7952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616850432 00000100:00100000:3.0:1787579343.846659:0:7952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787579343.846667:0:7952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616850432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787579343.846698:0:7952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787579343.846751:0:7952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616850432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579343.846758:0:7952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787579343.846781:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787579343.846807:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ce84f15500 x1874412616850432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579343.846823:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616850432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787579343.848421:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce87ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616850560:0@lo:400:kworker.0 00000100:00100000:0.0:1787579343.848471:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579343.848514:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce87aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1874412616851072:0@lo:400:kworker.0 00000100:00100000:0.0:1787579343.848539:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579343.848559:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787579343.848564:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce87aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616850688:0@lo:400:kworker.0 00000100:00100000:0.0:1787579343.848583:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579343.848613:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616850560 00000100:00100000:0.0:1787579343.848618:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616850560 00000100:00100000:0.0:1787579343.848654:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787579343.848662:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce85748450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3321:x1874412616850560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579343.848713:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce85748450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3321:x1874412616850560:12345-0@lo:400:kworker.0 Request processed in 52us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579343.848720:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787579343.848865:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616851072 00000100:00100000:0.0:1787579343.848870:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616851072 00000100:00100000:0.0:1787579343.848899:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616850688 00000100:00100000:0.0:1787579343.848903:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616850688 00000100:00100000:0.0:1787579343.848920:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787579343.848946:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874412616851072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579343.848979:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874412616851072:12345-0@lo:400:kworker.0 Request processed in 53us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579343.848985:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787579343.848997:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787579343.849003:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616850688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579343.849027:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616850688:12345-0@lo:400:kworker.0 Request processed in 25us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579343.849033:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787579343.849066:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce87aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616850688:0@lo:400:kworker.0 00000100:00100000:0.0:1787579343.849075:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce87ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616850560:0@lo:400:kworker.0 00000100:00100000:0.0:1787579343.849084:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce87aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1874412616851072:0@lo:400:kworker.0 00000100:00080000:0.0:1787579343.849561:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579343.849574:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce87ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616850816:0@lo:400:kworker.0 00000100:00100000:0.0:1787579343.849605:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579343.849627:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787579343.849633:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce87acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616850944:0@lo:400:kworker.0 00000100:00100000:0.0:1787579343.849666:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579343.849694:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616850816 00000100:00100000:0.0:1787579343.849699:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616850816 00000100:00100000:1.0:1787579343.850866:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616850944 00000100:00100000:1.0:1787579343.850874:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616850944 00000100:00100000:1.0:1787579343.850919:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787579343.850962:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616850944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579343.851026:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616850944:12345-0@lo:400:kworker.0 Request processed in 100us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579343.851033:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787579343.851052:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787579343.851056:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579343.851774:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787579343.851786:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616850816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579343.851831:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616850816:12345-0@lo:400:kworker.0 Request processed in 48us (2226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579343.851837:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1787579343.862904:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ce87acb800 x1874412616850944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579343.862959:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce87acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616850944:0@lo:400:kworker.0 00000100:00100000:1.0:1787579343.862975:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce87ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616850816:0@lo:400:kworker.0 00010000:00010000:3.0:1787579344.288203:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579344.361788:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616851200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787579344.361874:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579344.368204:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616851200 00000100:00100000:0.0:1787579344.368220:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616851200 00000100:00100000:0.0:1787579344.368291:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787579344.368302:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb468b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616851200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787579344.368338:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579344.368423:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb468b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616851200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (6548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579344.368430:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1787579344.369137:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceb4689500 x1874412616851200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579344.369160:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616851200:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787579345.313070:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579346.337198:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579347.367624:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579347.636467:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579347.636556:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579347.636592:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591653760 00000100:00100000:0.0:1787579347.636602:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591653760 00000100:00080000:1.0:1787579347.636665:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579347.636697:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 51 00000100:00100000:0.0:1787579347.636708:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+6:2360:x1874412591653760:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1787579347.636759:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591653632 00000100:00100000:3.0:1787579347.636778:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591653632 00000100:00100000:0.0:1787579347.636799:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+6:2360:x1874412591653760:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 92us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579347.636809:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 51 00000100:00100000:3.0:1787579347.636822:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 202 00000100:00100000:3.0:1787579347.636832:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+10:2359:x1874412591653632:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1787579347.636866:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+10:2359:x1874412591653632:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 37us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579347.636872:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 202 00010000:00010000:2.0:1787579348.384071:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579348.960327:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787579348.960358:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616851328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787579348.960446:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579348.960512:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616851328 00000100:00100000:3.0:1787579348.960520:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616851328 00000100:00100000:3.0:1787579348.960570:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787579348.960578:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616851328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787579348.960608:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787579348.960650:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616851328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579348.960656:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1787579348.960677:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787579348.960703:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ce84f15500 x1874412616851328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579348.960731:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616851328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787579348.964199:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616851840:0@lo:400:kworker.0 00000100:00100000:1.0:1787579348.964264:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579348.964301:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787579348.964308:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616851456:0@lo:400:kworker.0 00000100:00100000:1.0:1787579348.964345:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579348.964383:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616851840 00000100:00100000:1.0:1787579348.964401:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616851840 00000100:00100000:1.0:1787579348.964455:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787579348.964464:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616851840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579348.964514:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616851840:12345-0@lo:400:kworker.0 Request processed in 50us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579348.964520:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787579348.964541:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616851456 00000100:00100000:1.0:1787579348.964545:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616851456 00000100:00100000:1.0:1787579348.964570:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787579348.964577:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3319:x1874412616851456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579348.964605:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3319:x1874412616851456:12345-0@lo:400:kworker.0 Request processed in 28us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579348.964610:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:1.0:1787579348.964651:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787579348.964675:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616851456:0@lo:400:kworker.0 00010000:00080000:1.0:1787579348.964702:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceb4688380 x1874412616851840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579348.964966:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616851840:0@lo:400:kworker.0 00000100:00100000:2.0:1787579348.965107:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616851584:0@lo:400:kworker.0 00000100:00100000:2.0:1787579348.965142:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579348.965166:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787579348.965171:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4689880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616851712:0@lo:400:kworker.0 00000100:00100000:2.0:1787579348.965193:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579348.965220:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616851584 00000100:00100000:2.0:1787579348.965224:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616851584 00000100:00100000:2.0:1787579348.965251:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616851712 00000100:00100000:2.0:1787579348.965254:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616851712 00000100:00100000:2.0:1787579348.965274:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787579348.965280:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616851584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579348.965315:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616851584:12345-0@lo:400:kworker.0 Request processed in 36us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579348.965322:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787579348.965349:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787579348.965356:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb468aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616851712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579348.965380:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb468aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616851712:12345-0@lo:400:kworker.0 Request processed in 26us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579348.965508:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787579348.965547:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4689880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616851712:0@lo:400:kworker.0 00000100:00100000:2.0:1787579348.965557:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616851584:0@lo:400:kworker.0 00000100:00080000:1.0:1787579348.965633:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579348.965640:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787579348.965648:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1874412616851968:0@lo:400:kworker.0 00000100:00100000:1.0:1787579348.965675:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579348.965979:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616851968 00000100:00100000:2.0:1787579348.965984:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616851968 00000100:00100000:2.0:1787579348.966022:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787579348.966028:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874412616851968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579348.966074:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874412616851968:12345-0@lo:400:kworker.0 Request processed in 46us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579348.966080:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1787579348.966210:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579348.966231:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1874412616851968:0@lo:400:kworker.0 00010000:00010000:0.0:1787579349.409467:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579349.472817:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787579349.472841:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616852096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787579349.472968:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579349.473150:0:7952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616852096 00000100:00100000:1.0:1787579349.473158:0:7952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616852096 00000100:00100000:1.0:1787579349.473216:0:7952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787579349.473230:0:7952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616852096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787579349.473309:0:7952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579349.473375:0:7952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616852096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579349.473395:0:7952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1787579349.473555:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceb4688e00 x1874412616852096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579349.473574:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616852096:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787579350.433504:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579351.456185:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579352.480178:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787579352.653530:0:10147:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 09:49:10 (1787579350) === 00000100:00100000:1.0:1787579352.754277:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579352.754336:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579352.754391:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591653888 00000100:00100000:3.0:1787579352.754400:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591653888 00000100:00100000:3.0:1787579352.754452:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 204 00000100:00100000:3.0:1787579352.754462:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91ddb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+10:2361:x1874412591653888:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1787579352.754533:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91ddb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+10:2361:x1874412591653888:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 73us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579352.754541:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 204 00000100:00100000:2.0:1787579352.754602:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591654016 00000100:00100000:2.0:1787579352.754607:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591654016 00000100:00100000:2.0:1787579352.754657:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 55 00000100:00100000:2.0:1787579352.754665:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+6:2361:x1874412591654016:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1787579352.754696:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+6:2361:x1874412591654016:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 32us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579352.754703:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 55 00000100:00080000:3.0:1787579352.755054:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787579353.379868:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579353.380040:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591654144 00000100:00100000:1.0:1787579353.380050:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591654144 00000100:00100000:1.0:1787579353.380199:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 205 00000100:00100000:1.0:1787579353.380207:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+10:8145:x1874412591654144:12345-192.168.206.53@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787579353.380222:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579353.380236:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce8148a000/0xb72beeaffa1b6dd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01ce68 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579353.380261:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce8148a000/0xb72beeaffa1b6dd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce68 expref: 11 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579353.380271:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce8148a000/0xb72beeaffa1b6dd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce68 expref: 11 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579353.380284:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8148a000, rc 0) 00000100:00100000:1.0:1787579353.380355:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+11:8145:x1874412591654144:12345-192.168.206.53@tcp:101:mount.lustre.0 Request processed in 148us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579353.380363:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 205 00000100:00100000:2.0:1787579353.400592:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579353.402874:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591654272 00000100:00100000:1.0:1787579353.402886:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591654272 00000100:00100000:1.0:1787579353.402989:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 206 00000100:00100000:1.0:1787579353.403000:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+11:8145:x1874412591654272:12345-192.168.206.53@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787579353.403610:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+11:8145:x1874412591654272:12345-192.168.206.53@tcp:501:mount.lustre.0 Request processed in 610us (3036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579353.403619:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 206 00000100:00100000:2.0:1787579353.415693:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579353.415959:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591654400 00000100:00100000:3.0:1787579353.415969:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591654400 00000100:00100000:3.0:1787579353.416040:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 207 00000100:00100000:3.0:1787579353.416051:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+11:8145:x1874412591654400:12345-192.168.206.53@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787579353.416498:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+11:8145:x1874412591654400:12345-192.168.206.53@tcp:503:mount.lustre.0 Request processed in 447us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579353.416506:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 207 00000100:00100000:2.0:1787579353.423795:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579353.425770:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591654528 00000100:00100000:1.0:1787579353.425783:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591654528 00000100:00100000:1.0:1787579353.425856:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 208 00000100:00100000:1.0:1787579353.425865:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91ddb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+11:8149:x1874412591654528:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787579353.426202:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91ddb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+11:8149:x1874412591654528:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 336us (2413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579353.426210:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 208 00000100:00100000:0.0:1787579353.463459:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579353.463540:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591654656 00000100:00100000:2.0:1787579353.463555:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591654656 00000100:00100000:2.0:1787579353.463687:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 209 00000100:00100000:2.0:1787579353.463698:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+11:8149:x1874412591654656:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787579353.467856:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+11:8149:x1874412591654656:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 4150us (4399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579353.467882:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 209 00000100:00100000:2.0:1787579353.476270:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579353.476396:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591654784 00000100:00100000:3.0:1787579353.476407:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591654784 00000100:00100000:3.0:1787579353.476460:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 210 00000100:00100000:3.0:1787579353.476471:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91ddbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+11:8145:x1874412591654784:12345-192.168.206.53@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787579353.476488:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579353.476505:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce8152f600/0xb72beeaffa1b6ddf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01ce92 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579353.476532:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce8152f600/0xb72beeaffa1b6ddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce92 expref: 12 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579353.476543:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce8152f600/0xb72beeaffa1b6ddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce92 expref: 12 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579353.476552:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8152f600, rc 0) 00000100:00100000:3.0:1787579353.476618:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91ddbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+12:8145:x1874412591654784:12345-192.168.206.53@tcp:101:mount.lustre.0 Request processed in 148us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579353.476636:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 210 00000100:00100000:3.0:1787579353.479338:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579353.482502:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591654912 00000100:00100000:2.0:1787579353.482517:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591654912 00000100:00100000:3.0:1787579353.484725:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 211 00000100:00100000:3.0:1787579353.484738:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91ddb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+12:8145:x1874412591654912:12345-192.168.206.53@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787579353.484763:0:5859:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787579353.484786:0:5859:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787579353.484790:0:5859:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787579353.484793:0:5859:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787579353.484795:0:5859:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787579353.499566:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91ddb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+12:8145:x1874412591654912:12345-192.168.206.53@tcp:256:mount.lustre.0 Request processed in 14808us (20212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579353.499593:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 211 00010000:00010000:0.0:1787579353.504326:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579353.507326:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579353.510383:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591655040 00000100:00100000:1.0:1787579353.510398:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591655040 00000100:00100000:1.0:1787579353.510524:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 212 00000100:00100000:1.0:1787579353.510536:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+12:8145:x1874412591655040:12345-192.168.206.53@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787579353.510553:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579353.510570:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce8148ba00/0xb72beeaffa1b6de6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01ce99 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579353.510608:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce8148ba00/0xb72beeaffa1b6de6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce99 expref: 13 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579353.510619:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce8148ba00/0xb72beeaffa1b6de6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce99 expref: 13 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579353.510629:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8148ba00, rc 0) 00000100:00100000:1.0:1787579353.510701:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+13:8145:x1874412591655040:12345-192.168.206.53@tcp:101:mount.lustre.0 Request processed in 167us (3393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579353.510709:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 212 00000100:00100000:2.0:1787579353.515195:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579353.521951:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591655168 00000100:00100000:0.0:1787579353.521965:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591655168 00000100:00100000:0.0:1787579353.522026:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 213 00000100:00100000:0.0:1787579353.522035:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+13:8145:x1874412591655168:12345-192.168.206.53@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787579353.522366:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+13:8145:x1874412591655168:12345-192.168.206.53@tcp:501:mount.lustre.0 Request processed in 331us (7180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579353.522374:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 213 00000100:00100000:2.0:1787579353.527623:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579353.527992:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591655296 00000100:00100000:0.0:1787579353.528002:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591655296 00000100:00100000:0.0:1787579353.528055:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 214 00000100:00100000:0.0:1787579353.528064:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+13:8145:x1874412591655296:12345-192.168.206.53@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787579353.528661:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+13:8145:x1874412591655296:12345-192.168.206.53@tcp:503:mount.lustre.0 Request processed in 596us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579353.528670:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 214 00000100:00100000:2.0:1787579353.532709:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579353.532868:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591655424 00000100:00100000:1.0:1787579353.532878:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591655424 00000100:00100000:1.0:1787579353.533008:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 215 00000100:00100000:1.0:1787579353.533018:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+13:8154:x1874412591655424:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787579353.533269:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+13:8154:x1874412591655424:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 251us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579353.533285:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 215 00000100:00100000:2.0:1787579353.537553:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579353.537655:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591655552 00000100:00100000:0.0:1787579353.537667:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591655552 00000100:00100000:0.0:1787579353.537722:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 216 00000100:00100000:0.0:1787579353.537733:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+13:8154:x1874412591655552:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787579353.538448:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+13:8154:x1874412591655552:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 714us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579353.538520:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 216 00000100:00100000:2.0:1787579353.571565:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579353.571669:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579353.574631:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591655680 00000100:00100000:1.0:1787579353.574644:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591655680 00000100:00100000:1.0:1787579353.578141:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591656064 00000100:00100000:1.0:1787579353.578155:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591656064 00000100:00100000:1.0:1787579353.578399:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 56 00000100:00100000:1.0:1787579353.578411:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+6:2362:x1874412591656064:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579353.578494:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+6:2362:x1874412591656064:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 85us (6823us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579353.580350:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:2.0:1787579353.580362:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2358:x1874412591655680:12345-192.168.206.53@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787579353.580391:0:9532:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 10f8d08d-5315-46af-9d52-63a85ea5c0aa@192.168.206.53@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:2.0:1787579353.580427:0:9532:0:(genops.c:1385:class_connect()) connect: client 10f8d08d-5315-46af-9d52-63a85ea5c0aa, cookie 0xb72beeaffa1b6ded 00000004:00100000:2.0:1787579353.580455:0:9532:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787579353.580687:0:9532:0:(import.c:65:import_set_state_nolock()) ffffa0ce83122800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787579353.580735:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10f8d08d-5315-46af-9d52-63a85ea5c0aa+6:2358:x1874412591655680:12345-192.168.206.53@tcp:38:mount.lustre.0 Request processed in 374us (9179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579353.580743:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:1.0:1787579353.586681:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 56 00000100:00100000:2.0:1787579353.589661:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579353.590695:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591655936 00000100:00100000:1.0:1787579353.590710:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591655936 00000100:00100000:1.0:1787579353.590885:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:1.0:1787579353.590899:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10f8d08d-5315-46af-9d52-63a85ea5c0aa+6:8145:x1874412591655936:12345-192.168.206.53@tcp:41:mount.lustre.0 00000100:00080000:3.0:1787579353.594152:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1787579353.594386:0:5866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787579353.595264:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579353.595432:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591655808 00000100:00100000:0.0:1787579353.595444:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591655808 00000100:00100000:0.0:1787579353.595531:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:0.0:1787579353.595553:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb468b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10f8d08d-5315-46af-9d52-63a85ea5c0aa+7:0:x1874412591655808:12345-192.168.206.53@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787579353.595587:0:9532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787579353.596818:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10f8d08d-5315-46af-9d52-63a85ea5c0aa+7:8145:x1874412591655936:12345-192.168.206.53@tcp:41:mount.lustre.0 Request processed in 5911us (7162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579353.596831:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:0.0:1787579353.598489:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb468b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10f8d08d-5315-46af-9d52-63a85ea5c0aa+6:0:x1874412591655808:12345-192.168.206.53@tcp:41:mount.lustre.0 Request processed in 2934us (3221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579353.598505:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:2.0:1787579353.599515:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579353.599645:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591656192 00000100:00100000:0.0:1787579353.599654:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591656192 00000100:00100000:0.0:1787579353.599712:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 13 00000100:00100000:0.0:1787579353.599723:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10f8d08d-5315-46af-9d52-63a85ea5c0aa+6:8145:x1874412591656192:12345-192.168.206.53@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787579353.599821:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10f8d08d-5315-46af-9d52-63a85ea5c0aa+6:8145:x1874412591656192:12345-192.168.206.53@tcp:40:mount.lustre.0 Request processed in 99us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579353.599829:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 13 00000100:00100000:2.0:1787579353.602135:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579353.602191:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579353.602303:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579353.602436:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591656576 00000100:00100000:0.0:1787579353.602445:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591656576 00000100:00100000:0.0:1787579353.602491:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 1 00000100:00100000:0.0:1787579353.602500:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10f8d08d-5315-46af-9d52-63a85ea5c0aa+6:8145:x1874412591656576:12345-192.168.206.53@tcp:33:mount.lustre.0 00000100:00100000:1.0:1787579353.602706:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591656320 00000100:00100000:1.0:1787579353.602710:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591656320 00000004:00200000:0.0:1787579353.602718:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787579353.602735:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591656448 00000100:00100000:1.0:1787579353.602739:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591656448 00000100:00100000:1.0:1787579353.602764:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 13 00000100:00100000:1.0:1787579353.602770:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1874412591656320:12345-192.168.206.53@tcp:8:mount.lustre.0 00000100:00100000:2.0:1787579353.602771:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 14 00000100:00100000:2.0:1787579353.602786:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb468bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1874412591656448:12345-192.168.206.53@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787579353.602794:0:6710:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 10f8d08d-5315-46af-9d52-63a85ea5c0aa@192.168.206.53@tcp t0 exp 0000000000000000 cur 289 last 0 00010000:00080000:2.0:1787579353.602801:0:6712:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 10f8d08d-5315-46af-9d52-63a85ea5c0aa@192.168.206.53@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:2.0:1787579353.602825:0:6712:0:(genops.c:1385:class_connect()) connect: client 10f8d08d-5315-46af-9d52-63a85ea5c0aa, cookie 0xb72beeaffa1b6dfb 00000020:00000080:1.0:1787579353.602833:0:6710:0:(genops.c:1385:class_connect()) connect: client 10f8d08d-5315-46af-9d52-63a85ea5c0aa, cookie 0xb72beeaffa1b6df4 00002000:00100000:2.0:1787579353.602835:0:6712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 10f8d08d-5315-46af-9d52-63a85ea5c0aa/ffffa0ce83121800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787579353.602843:0:6710:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 10f8d08d-5315-46af-9d52-63a85ea5c0aa/ffffa0cebf867000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787579353.602856:0:6712:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00100000:1.0:1787579353.602856:0:6710:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787579353.602872:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10f8d08d-5315-46af-9d52-63a85ea5c0aa+6:8145:x1874412591656576:12345-192.168.206.53@tcp:33:mount.lustre.0 Request processed in 371us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579353.602881:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 1 00002000:00080000:1.0:1787579353.603047:0:6710:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787579353.603073:0:6710:0:(import.c:65:import_set_state_nolock()) ffffa0cebf865000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787579353.603116:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10f8d08d-5315-46af-9d52-63a85ea5c0aa+6:2358:x1874412591656320:12345-192.168.206.53@tcp:8:mount.lustre.0 Request processed in 345us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579353.603124:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 13 00002000:00080000:2.0:1787579353.603198:0:6712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787579353.603214:0:6712:0:(import.c:65:import_set_state_nolock()) ffffa0ce83120800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787579353.603246:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb468bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10f8d08d-5315-46af-9d52-63a85ea5c0aa+6:2358:x1874412591656448:12345-192.168.206.53@tcp:8:mount.lustre.0 Request processed in 455us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579353.603255:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 14 00000100:00100000:1.0:1787579354.080323:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616852224:0@lo:400:kworker.0 00000100:00100000:0.0:1787579354.080355:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616852608:0@lo:400:kworker.0 00000100:00100000:1.0:1787579354.080399:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579354.080420:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579354.080456:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec17c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616852736:0@lo:400:kworker.0 00000100:00100000:0.0:1787579354.080474:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1874412616852480:0@lo:400:kworker.0 00000100:00100000:1.0:1787579354.080487:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579354.080512:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579354.080542:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616852352:0@lo:400:kworker.0 00000100:00100000:0.0:1787579354.080554:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616852608 00000100:00100000:0.0:1787579354.080562:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616852608 00000100:00100000:1.0:1787579354.080583:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579354.080604:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec17c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1874412616852864:0@lo:400:kworker.0 00000100:00100000:0.0:1787579354.080617:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616852736 00000100:00100000:0.0:1787579354.080621:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616852736 00000100:00100000:0.0:1787579354.080642:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787579354.080651:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616852608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579354.080700:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616852608:12345-0@lo:400:kworker.0 Request processed in 49us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579354.080706:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787579354.080721:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787579354.080726:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616852736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579354.080755:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616852736:12345-0@lo:400:kworker.0 Request processed in 29us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579354.080761:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787579354.080779:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787579354.080798:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceb4689c00 x1874412616852608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579354.080813:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616852608:0@lo:400:kworker.0 00010000:00080000:1.0:1787579354.080832:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec17c5c00 x1874412616852736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579354.080841:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616852480 00000100:00100000:1.0:1787579354.080844:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec17c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616852736:0@lo:400:kworker.0 00000100:00100000:0.0:1787579354.080846:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616852480 00000100:00100000:0.0:1787579354.080876:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616852352 00000100:00100000:0.0:1787579354.080879:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616852352 00000100:00080000:2.0:1787579354.080915:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787579354.080921:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787579354.080923:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787579354.080990:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616852992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787579354.081023:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579354.081054:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616852992 00000100:00100000:3.0:1787579354.081058:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616852992 00000100:00100000:3.0:1787579354.081085:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787579354.081092:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616852992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787579354.081107:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787579354.081142:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616852992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579354.081149:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1787579354.081174:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceb4463100 x1874412616852992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579354.081202:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616852992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787579354.081240:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616852224 00000100:00100000:3.0:1787579354.081244:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616852224 00000100:00100000:3.0:1787579354.081269:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787579354.081276:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3322:x1874412616852224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579354.081326:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3322:x1874412616852224:12345-0@lo:400:kworker.0 Request processed in 51us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579354.081333:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787579354.081384:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616852224:0@lo:400:kworker.0 00000100:00100000:1.0:1787579354.083463:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616852864 00000100:00100000:1.0:1787579354.083477:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616852864 00000100:00100000:0.0:1787579354.083484:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787579354.083504:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874412616852480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579354.083531:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787579354.083541:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616852352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579354.083583:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874412616852480:12345-0@lo:400:kworker.0 Request processed in 90us (3071us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579354.083605:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787579354.083610:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616852352:12345-0@lo:400:kworker.0 Request processed in 70us (3026us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579354.083625:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787579354.083641:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1787579354.083667:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579354.083713:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1874412616852480:0@lo:400:kworker.0 00000100:00100000:0.0:1787579354.083740:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874412616852864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579354.083766:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616852352:0@lo:400:kworker.0 00000100:00100000:0.0:1787579354.083781:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874412616852864:12345-0@lo:400:kworker.0 Request processed in 148us (3003us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579354.083789:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787579354.083797:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec17c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1874412616852864:0@lo:400:kworker.0 00010000:00010000:3.0:1787579354.528276:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579354.592284:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec17c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616853120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787579354.592374:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579354.592503:0:7952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616853120 00000100:00100000:2.0:1787579354.592525:0:7952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616853120 00000100:00100000:2.0:1787579354.592602:0:7952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787579354.592614:0:7952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616853120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787579354.592645:0:7952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579354.592731:0:7952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616853120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579354.592739:0:7952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1787579354.592788:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec17c5500 x1874412616853120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579354.593097:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec17c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616853120:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787579355.552653:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787579356.188269:0:7670:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 10f8d08d-5315-46af-9d52-63a85ea5c0aa 00010000:00010000:2.0:1787579356.576816:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787579357.212505:0:5888:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 10f8d08d-5315-46af-9d52-63a85ea5c0aa 00000001:00100000:1.0:1787579357.232322:0:6735:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 10f8d08d-5315-46af-9d52-63a85ea5c0aa 00010000:00010000:0.0:1787579357.600076:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579358.625746:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579358.897242:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579358.897347:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591656704 00000100:00100000:0.0:1787579358.897356:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591656704 00000100:00100000:0.0:1787579358.897405:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 218 00000100:00100000:0.0:1787579358.897415:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+13:2360:x1874412591656704:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579358.897508:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+13:2360:x1874412591656704:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 95us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579358.897516:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 218 00000100:00100000:3.0:1787579358.899756:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579358.899797:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579358.899840:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579358.899883:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579358.900152:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591656960 00000100:00100000:2.0:1787579358.900160:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591656960 00000100:00100000:2.0:1787579358.900223:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591656832 00000100:00100000:2.0:1787579358.900226:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591656832 00000100:00100000:2.0:1787579358.900248:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 60 00000100:00100000:2.0:1787579358.900269:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2360:x1874412591656960:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1787579358.900348:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2360:x1874412591656960:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 80us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579358.900355:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 60 00000100:00100000:2.0:1787579358.900370:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 61 00000100:00100000:2.0:1787579358.900376:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+6:2360:x1874412591656832:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1787579358.900395:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+6:2360:x1874412591656832:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 21us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579358.900401:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 61 00000100:00080000:3.0:1787579358.900586:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579358.900640:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591657216 00000100:00100000:0.0:1787579358.900644:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591657216 00000100:00100000:0.0:1787579358.900684:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591657088 00000100:00100000:0.0:1787579358.900687:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591657088 00000100:00100000:0.0:1787579358.900706:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 28 00000100:00100000:0.0:1787579358.900713:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2360:x1874412591657216:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579358.900750:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2360:x1874412591657216:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 38us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579358.900757:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 28 00000100:00100000:0.0:1787579358.900769:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 29 00000100:00100000:0.0:1787579358.900776:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2360:x1874412591657088:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579358.900798:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2360:x1874412591657088:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 23us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579358.900804:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 29 00000100:00080000:3.0:1787579358.900941:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787579358.900945:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787579359.201158:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874412616853504:0@lo:400:kworker.0 00000100:00100000:1.0:1787579359.201456:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579359.201522:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebfa54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3320:1874412616854016:0@lo:400:kworker.0 00000100:00100000:1.0:1787579359.201546:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579359.201576:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787579359.201742:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616853376:0@lo:400:kworker.0 00000100:00100000:1.0:1787579359.201773:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579359.201796:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebfa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616853888:0@lo:400:kworker.0 00000100:00100000:1.0:1787579359.201820:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579359.201847:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616853376 00000100:00100000:1.0:1787579359.201854:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616853376 00000100:00100000:1.0:1787579359.201891:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787579359.201900:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3320:x1874412616853376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579359.201968:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3320:x1874412616853376:12345-0@lo:400:kworker.0 Request processed in 68us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579359.201985:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787579359.202018:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616853504 00000100:00100000:1.0:1787579359.202022:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616853504 00000100:00100000:1.0:1787579359.202044:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616854016 00000100:00100000:1.0:1787579359.202047:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616854016 00000100:00100000:3.0:1787579359.202148:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787579359.202157:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874412616853504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579359.202210:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874412616853504:12345-0@lo:400:kworker.0 Request processed in 55us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579359.202224:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787579359.202687:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616853632:0@lo:400:kworker.0 00000100:00100000:2.0:1787579359.202719:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579359.202747:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787579359.202754:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616853248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787579359.202777:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579359.202796:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616853760:0@lo:400:kworker.0 00000100:00100000:2.0:1787579359.202818:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579359.202846:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616853248 00000100:00100000:2.0:1787579359.202850:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616853248 00000100:00100000:2.0:1787579359.202888:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787579359.202895:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec17c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616853248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787579359.202920:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579359.202974:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec17c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616853248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579359.202979:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787579359.202999:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616853888 00000100:00100000:2.0:1787579359.203009:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616853888 00000100:00100000:2.0:1787579359.203031:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616853760 00000100:00100000:2.0:1787579359.203034:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616853760 00000100:00100000:2.0:1787579359.203066:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787579359.203073:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616853888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579359.203104:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616853888:12345-0@lo:400:kworker.0 Request processed in 32us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579359.203110:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787579359.203122:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787579359.203128:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec17c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616853760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579359.203154:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec17c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616853760:12345-0@lo:400:kworker.0 Request processed in 27us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579359.203160:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1787579359.203447:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787579359.203451:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787579359.203477:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceb4461c00 x1874412616853248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579359.203496:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616853248:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787579359.203507:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceba833800 x1874412616853760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579359.203515:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616853760:0@lo:400:kworker.0 00000100:00100000:2.0:1787579359.203556:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616853376:0@lo:400:kworker.0 00010000:00080000:2.0:1787579359.203566:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cebfa57480 x1874412616853888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579359.203574:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebfa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616853888:0@lo:400:kworker.0 00000100:00100000:1.0:1787579359.203794:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616853632 00000100:00100000:1.0:1787579359.203798:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616853632 00000100:00100000:1.0:1787579359.203817:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787579359.203822:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874412616854016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579359.203864:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874412616854016:12345-0@lo:400:kworker.0 Request processed in 41us (2316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579359.203870:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787579359.203882:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787579359.203888:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec17c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616853632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579359.203917:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec17c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616853632:12345-0@lo:400:kworker.0 Request processed in 29us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579359.203923:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787579359.203966:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616853632:0@lo:400:kworker.0 00000100:00080000:1.0:1787579359.203990:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787579359.204372:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874412616853504:0@lo:400:kworker.0 00000100:00100000:2.0:1787579359.204383:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebfa54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3320:1874412616854016:0@lo:400:kworker.0 00010000:00010000:1.0:1787579359.656892:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579359.714661:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787579359.714692:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec17c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616854144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787579359.714755:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579359.714990:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616854144 00000100:00100000:3.0:1787579359.715007:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616854144 00000100:00100000:3.0:1787579359.715408:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787579359.715422:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616854144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787579359.715472:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787579359.715555:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616854144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579359.715565:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1787579359.715750:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec17c5880 x1874412616854144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579359.715773:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec17c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616854144:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1787579360.584738:0:10345:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg653-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1787579360.673138:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579361.701908:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579362.720142:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579363.744087:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579364.023467:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579364.025807:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579364.025856:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579364.025885:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579364.025912:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579364.025978:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591657856 00000100:00100000:1.0:1787579364.025988:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591657856 00000100:00100000:1.0:1787579364.026043:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591657728 00000100:00100000:1.0:1787579364.026047:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591657728 00000100:00100000:1.0:1787579364.026084:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 32 00000100:00100000:1.0:1787579364.026095:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2359:x1874412591657856:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579364.026161:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2359:x1874412591657856:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 68us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579364.026168:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 32 00000100:00100000:1.0:1787579364.026183:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 33 00000100:00100000:1.0:1787579364.026201:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2359:x1874412591657728:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579364.026226:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2359:x1874412591657728:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 25us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579364.026232:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 33 00000100:00100000:1.0:1787579364.026394:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591657600 00000100:00100000:1.0:1787579364.026399:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591657600 00000100:00100000:1.0:1787579364.026429:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591657472 00000100:00100000:1.0:1787579364.026431:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591657472 00000100:00100000:1.0:1787579364.026455:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 65 00000100:00100000:1.0:1787579364.026462:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2359:x1874412591657600:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579364.026493:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2359:x1874412591657600:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 32us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579364.026500:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 65 00000100:00100000:1.0:1787579364.026772:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 66 00000100:00100000:1.0:1787579364.026782:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+6:2359:x1874412591657472:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579364.026812:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+6:2359:x1874412591657472:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 33us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579364.026828:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 66 00000100:00080000:1.0:1787579364.026853:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787579364.026857:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787579364.026860:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787579364.033060:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591657344 00000100:00100000:2.0:1787579364.033087:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591657344 00000100:00100000:2.0:1787579364.033152:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 220 00000100:00100000:2.0:1787579364.033162:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+13:2359:x1874412591657344:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1787579364.033450:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+13:2359:x1874412591657344:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 287us (9991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579364.033458:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 220 00000100:00100000:0.0:1787579364.321137:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec17c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616854272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787579364.321205:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579364.321534:0:7952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616854272 00000100:00100000:2.0:1787579364.321542:0:7952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616854272 00000100:00100000:2.0:1787579364.321604:0:7952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787579364.321614:0:7952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616854272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787579364.321647:0:7952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579364.321693:0:7952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616854272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579364.321700:0:7952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1787579364.321754:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787579364.321785:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec17c4380 x1874412616854272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579364.321804:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec17c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616854272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787579364.324572:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874412616854528:0@lo:400:kworker.0 00000100:00100000:2.0:1787579364.324639:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579364.324676:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787579364.324683:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616854400:0@lo:400:kworker.0 00000100:00100000:2.0:1787579364.324711:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579364.324756:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616854528 00000100:00100000:2.0:1787579364.324763:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616854528 00000100:00100000:2.0:1787579364.324804:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787579364.324819:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec17c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874412616854528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579364.324868:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec17c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874412616854528:12345-0@lo:400:kworker.0 Request processed in 51us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579364.324881:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787579364.324954:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874412616854528:0@lo:400:kworker.0 00000100:00100000:1.0:1787579364.325287:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616854400 00000100:00100000:1.0:1787579364.325292:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616854400 00000100:00100000:1.0:1787579364.325330:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787579364.325338:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3320:x1874412616854400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579364.325383:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3320:x1874412616854400:12345-0@lo:400:kworker.0 Request processed in 46us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579364.325389:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787579364.325426:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616854400:0@lo:400:kworker.0 00000100:00100000:1.0:1787579364.328186:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787579364.328290:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787579364.328309:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616854784:0@lo:400:kworker.0 00000100:00100000:0.0:1787579364.328369:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579364.332485:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616854784 00000100:00100000:2.0:1787579364.332500:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616854784 00000100:00100000:2.0:1787579364.332587:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787579364.332598:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616854784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579364.332689:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616854784:12345-0@lo:400:kworker.0 Request processed in 93us (4319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579364.332696:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787579364.332981:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3322:1874412616854656:0@lo:400:kworker.0 00000100:00100000:1.0:1787579364.333022:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579364.333229:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616854656 00000100:00100000:1.0:1787579364.333234:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616854656 00000100:00100000:1.0:1787579364.333284:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787579364.333292:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1874412616854656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579364.333327:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1874412616854656:12345-0@lo:400:kworker.0 Request processed in 37us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579364.333334:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787579364.333370:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3322:1874412616854656:0@lo:400:kworker.0 00000100:00080000:2.0:1787579364.333989:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787579364.333995:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787579364.334570:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceb4462680 x1874412616854784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579364.334605:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616854784:0@lo:400:kworker.0 00000100:00100000:3.0:1787579364.339100:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1874412616854912:0@lo:400:kworker.0 00000100:00100000:3.0:1787579364.339162:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579364.339211:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616854912 00000100:00100000:3.0:1787579364.339218:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616854912 00000100:00100000:3.0:1787579364.339303:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787579364.339312:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874412616854912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579364.339362:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874412616854912:12345-0@lo:400:kworker.0 Request processed in 51us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579364.339369:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1787579364.339390:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787579364.339418:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1874412616854912:0@lo:400:kworker.0 00010000:00010000:3.0:1787579364.768089:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579364.833657:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787579364.833834:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec17c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616855040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787579364.833903:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579364.834152:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616855040 00000100:00100000:0.0:1787579364.834161:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616855040 00000100:00100000:0.0:1787579364.834266:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787579364.834277:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616855040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787579364.834382:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579364.834438:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616855040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579364.834446:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1787579364.834514:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec17c4000 x1874412616855040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579364.834549:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec17c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616855040:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787579365.792049:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579366.816495:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579367.850168:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579368.864158:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579369.137670:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579369.137711:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579369.137756:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579369.137780:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579369.137801:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591658240 00000100:00100000:1.0:1787579369.137804:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579369.137816:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591658240 00000100:00100000:1.0:1787579369.137830:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591658496 00000100:00100000:1.0:1787579369.137835:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591658496 00000100:00100000:1.0:1787579369.137880:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591658368 00000100:00100000:1.0:1787579369.137884:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591658368 00000100:00100000:0.0:1787579369.137889:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591658112 00000100:00100000:0.0:1787579369.137897:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591658112 00000100:00100000:1.0:1787579369.137916:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 35 00000100:00100000:1.0:1787579369.137960:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2361:x1874412591658496:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579369.137975:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 70 00000100:00100000:0.0:1787579369.137988:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2361:x1874412591658240:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579369.138037:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2361:x1874412591658496:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 111us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579369.138043:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2361:x1874412591658240:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 56us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579369.138051:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 35 00000100:00100000:0.0:1787579369.138061:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 70 00000100:00100000:1.0:1787579369.138075:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 36 00000100:00100000:1.0:1787579369.138085:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2361:x1874412591658368:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579369.138091:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 71 00000100:00100000:0.0:1787579369.138104:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+6:2361:x1874412591658112:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579369.138117:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2361:x1874412591658368:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 33us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579369.138123:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 36 00000100:00100000:0.0:1787579369.138139:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+6:2361:x1874412591658112:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 37us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579369.138146:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 71 00000100:00100000:3.0:1787579369.138873:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591657984 00000100:00100000:3.0:1787579369.138880:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591657984 00000100:00100000:3.0:1787579369.138923:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 222 00000100:00100000:3.0:1787579369.138947:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+13:2361:x1874412591657984:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1787579369.138984:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+13:2361:x1874412591657984:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 40us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579369.138991:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 222 00000100:00080000:3.0:1787579369.139029:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787579369.139034:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787579369.139037:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579369.442067:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787579369.442091:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce87ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616855168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787579369.442155:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579369.442331:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616855680:0@lo:400:kworker.0 00000100:00100000:0.0:1787579369.442359:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579369.442379:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787579369.442385:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616855296:0@lo:400:kworker.0 00000100:00100000:0.0:1787579369.442424:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579369.442447:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1874412616855808:0@lo:400:kworker.0 00000100:00100000:0.0:1787579369.442469:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579369.442494:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616855424:0@lo:400:kworker.0 00000100:00100000:0.0:1787579369.442516:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579369.442533:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787579369.442538:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616855552:0@lo:400:kworker.0 00000100:00100000:0.0:1787579369.442559:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579369.442589:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616855680 00000100:00100000:3.0:1787579369.442649:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616855168 00000100:00100000:3.0:1787579369.442655:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616855168 00000100:00100000:3.0:1787579369.442705:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787579369.442713:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4688380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616855168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787579369.442746:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787579369.442786:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4688380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616855168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579369.442792:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1787579369.442811:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787579369.443586:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616855680 00000100:00080000:3.0:1787579369.443849:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787579369.443875:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787579369.443884:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616855680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579369.443966:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616855680:12345-0@lo:400:kworker.0 Request processed in 84us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579369.443973:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787579369.444021:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec1a61880 x1874412616855680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579369.444035:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616855680:0@lo:400:kworker.0 00000100:00100000:0.0:1787579369.447414:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616855296 00000100:00100000:0.0:1787579369.447427:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616855296 00000100:00100000:0.0:1787579369.447554:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787579369.447564:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3321:x1874412616855296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579369.447717:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3321:x1874412616855296:12345-0@lo:400:kworker.0 Request processed in 154us (5291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579369.447975:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616855296:0@lo:400:kworker.0 00000100:00100000:0.0:1787579369.448155:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787579369.448315:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616855808 00000100:00100000:1.0:1787579369.448322:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616855808 00000100:00100000:1.0:1787579369.448400:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616855424 00000100:00100000:1.0:1787579369.448414:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616855424 00000100:00100000:1.0:1787579369.448436:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616855552 00000100:00100000:1.0:1787579369.448439:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616855552 00000100:00100000:0.0:1787579369.448567:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787579369.448577:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874412616855808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579369.448641:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874412616855808:12345-0@lo:400:kworker.0 Request processed in 66us (6170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579369.448647:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787579369.448662:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787579369.448667:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616855424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579369.448699:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616855424:12345-0@lo:400:kworker.0 Request processed in 32us (6182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579369.448704:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787579369.448763:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616855424:0@lo:400:kworker.0 00000100:00100000:0.0:1787579369.448796:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1874412616855808:0@lo:400:kworker.0 00000100:00080000:2.0:1787579369.448974:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579369.449238:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787579369.449246:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616855552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579369.449301:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616855552:12345-0@lo:400:kworker.0 Request processed in 56us (6741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579369.449306:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787579369.449478:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616855552:0@lo:400:kworker.0 00010000:00080000:1.0:1787579369.449537:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ce87ac8000 x1874412616855168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579369.449554:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce87ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616855168:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787579369.888078:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579369.953193:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787579369.953216:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec17c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616855936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787579369.953299:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579369.953484:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616855936 00000100:00100000:3.0:1787579369.953492:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616855936 00000100:00100000:3.0:1787579369.953545:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787579369.953554:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616855936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787579369.953586:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787579369.953639:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616855936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579369.953646:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1787579369.953821:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec17c6a00 x1874412616855936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579369.953851:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec17c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616855936:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787579370.912246:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579371.937261:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579372.964308:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579373.985909:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579374.259693:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579374.259735:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579374.259754:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579374.259771:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579374.259795:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579374.259818:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591659008 00000100:00100000:1.0:1787579374.259826:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591659008 00000100:00100000:1.0:1787579374.259873:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591659136 00000100:00100000:1.0:1787579374.259882:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591659136 00000100:00100000:1.0:1787579374.259921:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 15 00000100:00100000:1.0:1787579374.259983:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2358:x1874412591659008:12345-192.168.206.53@tcp:9:kworker.0 00000020:00000080:1.0:1787579374.260008:0:6711:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6df4 00000100:00080000:1.0:1787579374.260016:0:6711:0:(import.c:65:import_set_state_nolock()) ffffa0cebf865000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787579374.260055:0:6711:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787579374.260377:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10f8d08d-5315-46af-9d52-63a85ea5c0aa+2:2358:x1874412591659008:12345-192.168.206.53@tcp:9:kworker.0 Request processed in 406us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579374.260385:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 15 00000100:00100000:1.0:1787579374.260400:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00100000:1.0:1787579374.260406:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2358:x1874412591659136:12345-192.168.206.53@tcp:9:kworker.0 00000020:00000080:1.0:1787579374.260418:0:6711:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6dfb 00000100:00080000:1.0:1787579374.260423:0:6711:0:(import.c:65:import_set_state_nolock()) ffffa0ce83120800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787579374.260452:0:6711:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787579374.260630:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10f8d08d-5315-46af-9d52-63a85ea5c0aa+2:2358:x1874412591659136:12345-192.168.206.53@tcp:9:kworker.0 Request processed in 223us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579374.260637:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00080000:1.0:1787579374.260658:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787579374.260661:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787579374.260783:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579374.261159:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579374.261460:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591658624 00000100:00100000:0.0:1787579374.261467:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591658624 00000100:00100000:0.0:1787579374.261509:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 224 00000100:00100000:0.0:1787579374.261517:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+13:2360:x1874412591658624:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579374.261551:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+13:2360:x1874412591658624:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 36us (1866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579374.261558:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 224 00000100:00100000:0.0:1787579374.261587:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591658880 00000100:00100000:0.0:1787579374.261591:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591658880 00000100:00100000:0.0:1787579374.261621:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591658752 00000100:00100000:0.0:1787579374.261632:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591658752 00000100:00100000:0.0:1787579374.261658:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 75 00000100:00100000:0.0:1787579374.261665:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2360:x1874412591658880:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579374.261695:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2360:x1874412591658880:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 30us (1959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579374.261701:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 75 00000100:00100000:0.0:1787579374.261713:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 76 00000100:00100000:0.0:1787579374.261719:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+6:2360:x1874412591658752:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579374.261742:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+6:2360:x1874412591658752:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 23us (1987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579374.261748:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 76 00000100:00080000:0.0:1787579374.261775:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787579374.560320:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616856064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787579374.560382:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579374.560477:0:7952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616856064 00000100:00100000:3.0:1787579374.560485:0:7952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616856064 00000100:00100000:3.0:1787579374.560538:0:7952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787579374.560548:0:7952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec17c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616856064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787579374.560579:0:7952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579374.563310:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616856192:0@lo:400:kworker.0 00000100:00100000:0.0:1787579374.563380:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579374.563416:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba812d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1874412616856704:0@lo:400:kworker.0 00000100:00100000:0.0:1787579374.563443:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579374.563470:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787579374.563475:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616856320:0@lo:400:kworker.0 00000100:00100000:0.0:1787579374.563495:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579374.563607:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616856192 00000100:00100000:0.0:1787579374.563613:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616856192 00000100:00100000:0.0:1787579374.563652:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787579374.563662:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3321:x1874412616856192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579374.563711:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3321:x1874412616856192:12345-0@lo:400:kworker.0 Request processed in 50us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579374.563728:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787579374.563761:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616856704 00000100:00100000:0.0:1787579374.563765:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616856704 00000100:00100000:0.0:1787579374.563792:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616856320 00000100:00100000:0.0:1787579374.563796:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616856320 00000100:00100000:0.0:1787579374.563814:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787579374.563821:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874412616856704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579374.563854:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874412616856704:12345-0@lo:400:kworker.0 Request processed in 34us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579374.563861:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787579374.563873:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787579374.563880:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616856320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579374.564069:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616856320:12345-0@lo:400:kworker.0 Request processed in 189us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579374.564075:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787579374.564103:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba810700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616856448:0@lo:400:kworker.0 00000100:00100000:0.0:1787579374.564127:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579374.564147:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787579374.564152:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616856576:0@lo:400:kworker.0 00000100:00100000:3.0:1787579374.564272:0:7952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec17c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616856064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3723us (3888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579374.564281:0:7952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1787579374.564311:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787579374.564316:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787579374.565042:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579374.565090:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616856448 00000100:00100000:0.0:1787579374.565096:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616856448 00000100:00100000:0.0:1787579374.565135:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787579374.565143:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616856448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579374.565269:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616856448:12345-0@lo:400:kworker.0 Request processed in 126us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579374.565285:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787579374.565469:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616856320:0@lo:400:kworker.0 00000100:00100000:0.0:1787579374.565480:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616856192:0@lo:400:kworker.0 00000100:00100000:0.0:1787579374.565490:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba812d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1874412616856704:0@lo:400:kworker.0 00000100:00100000:0.0:1787579374.565525:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba810700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616856448:0@lo:400:kworker.0 00000100:00100000:3.0:1787579374.565663:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616856576 00000100:00100000:3.0:1787579374.565668:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616856576 00000100:00100000:3.0:1787579374.565705:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787579374.565713:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba18c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616856576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579374.565777:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba18c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616856576:12345-0@lo:400:kworker.0 Request processed in 65us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579374.565793:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1787579374.566066:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec1a60e00 x1874412616856064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579374.566085:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616856064:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787579374.566355:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787579374.566360:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787579374.566549:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceba813b80 x1874412616856576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579374.566559:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616856576:0@lo:400:kworker.0 00010000:00010000:3.0:1787579375.008148:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579375.072386:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787579375.072410:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec17c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616856832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787579375.072475:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579375.072578:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616856832 00000100:00100000:2.0:1787579375.072585:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616856832 00000100:00100000:2.0:1787579375.072634:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787579375.072643:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616856832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787579375.072689:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579375.072737:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616856832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579375.072744:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1787579375.072815:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec17c4a80 x1874412616856832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579375.072831:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec17c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616856832:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787579376.032326:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787579376.644540:0:7670:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 10f8d08d-5315-46af-9d52-63a85ea5c0aa 00000020:00000080:3.0:1787579376.644549:0:7670:0:(genops.c:885:class_export_put()) final put ffffa0ce83121800/10f8d08d-5315-46af-9d52-63a85ea5c0aa 00000020:00000080:0.0:1787579376.644630:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ce83121800/10f8d08d-5315-46af-9d52-63a85ea5c0aa for lustre-OST0001 00000020:00000080:0.0:1787579376.644742:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0ce83120800 for lustre-OST0001 00010000:00010000:1.0:1787579377.056156:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787579377.717879:0:6735:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 10f8d08d-5315-46af-9d52-63a85ea5c0aa 00000020:00000080:0.0:1787579377.717886:0:6735:0:(genops.c:885:class_export_put()) final put ffffa0cebf867000/10f8d08d-5315-46af-9d52-63a85ea5c0aa 00000020:00000080:0.0:1787579377.717911:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa0cebf867000/10f8d08d-5315-46af-9d52-63a85ea5c0aa for lustre-OST0000 00000020:00000080:0.0:1787579377.717983:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0cebf865000 for lustre-OST0000 00000001:02000400:1.0:1787579378.042311:0:11049:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787579378.080356:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579379.104147:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579379.379500:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579379.379553:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579379.379584:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579379.379617:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591659392 00000100:00100000:1.0:1787579379.379627:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591659392 00000100:00100000:3.0:1787579379.379653:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591659264 00000100:00100000:3.0:1787579379.379668:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591659264 00000100:00100000:3.0:1787579379.379736:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 226 00000100:00100000:3.0:1787579379.379748:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+13:2361:x1874412591659264:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1787579379.379853:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+13:2361:x1874412591659264:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 106us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579379.379862:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 226 00000100:00100000:1.0:1787579379.379920:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591659520 00000100:00100000:1.0:1787579379.379945:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591659520 00000100:00100000:1.0:1787579379.379977:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 80 00000100:00100000:1.0:1787579379.379986:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+6:2361:x1874412591659392:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579379.380044:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+6:2361:x1874412591659392:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 59us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579379.380052:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 80 00000100:00100000:1.0:1787579379.380071:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 81 00000100:00100000:1.0:1787579379.380077:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2361:x1874412591659520:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579379.380103:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2361:x1874412591659520:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 26us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579379.380109:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 81 00000100:00080000:2.0:1787579379.380502:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787579379.684640:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616856960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787579379.684719:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579379.684803:0:7952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616856960 00000100:00100000:3.0:1787579379.684811:0:7952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616856960 00000100:00100000:3.0:1787579379.684881:0:7952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787579379.684890:0:7952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec17c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616856960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787579379.684922:0:7952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787579379.685025:0:7952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec17c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616856960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579379.685033:0:7952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1787579379.685235:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787579379.685261:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceb4460700 x1874412616856960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579379.685281:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616856960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787579379.686711:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3322:1874412616857344:0@lo:400:kworker.0 00000100:00100000:3.0:1787579379.686777:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579379.686808:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787579379.686824:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3322:1874412616857216:0@lo:400:kworker.0 00000100:00100000:3.0:1787579379.686847:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579379.686876:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616857344 00000100:00100000:3.0:1787579379.686882:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616857344 00000100:00100000:3.0:1787579379.686922:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616857216 00000100:00100000:3.0:1787579379.686956:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616857216 00000100:00100000:3.0:1787579379.686979:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787579379.686987:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1874412616857344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579379.687030:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1874412616857344:12345-0@lo:400:kworker.0 Request processed in 44us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579379.687037:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787579379.687051:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787579379.687057:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1874412616857216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579379.687081:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1874412616857216:12345-0@lo:400:kworker.0 Request processed in 24us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579379.687086:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787579379.687114:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3322:1874412616857216:0@lo:400:kworker.0 00000100:00100000:3.0:1787579379.687124:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3322:1874412616857344:0@lo:400:kworker.0 00000100:00100000:2.0:1787579379.687810:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616857088:0@lo:400:kworker.0 00000100:00100000:2.0:1787579379.687863:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579379.687903:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3320:1874412616857600:0@lo:400:kworker.0 00000100:00100000:2.0:1787579379.687959:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579379.687981:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787579379.687987:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616857472:0@lo:400:kworker.0 00000100:00100000:2.0:1787579379.688009:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579379.688035:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616857600 00000100:00100000:2.0:1787579379.688040:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616857600 00000100:00100000:2.0:1787579379.688068:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787579379.688075:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec17c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874412616857600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579379.688112:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec17c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874412616857600:12345-0@lo:400:kworker.0 Request processed in 37us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579379.688118:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1787579379.688143:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787579379.688164:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3320:1874412616857600:0@lo:400:kworker.0 00000100:00100000:1.0:1787579379.688388:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616857088 00000100:00100000:1.0:1787579379.688393:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616857088 00000100:00100000:1.0:1787579379.688425:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787579379.688431:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3320:x1874412616857088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579379.688476:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3320:x1874412616857088:12345-0@lo:400:kworker.0 Request processed in 45us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579379.688481:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787579379.688512:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616857472 00000100:00100000:1.0:1787579379.688515:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616857472 00000100:00100000:1.0:1787579379.688544:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787579379.688550:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec17c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616857472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579379.688578:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec17c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616857472:12345-0@lo:400:kworker.0 Request processed in 28us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579379.688584:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1787579379.688597:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787579379.688612:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceb4460000 x1874412616857472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579379.688622:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616857472:0@lo:400:kworker.0 00000100:00100000:1.0:1787579379.688629:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616857088:0@lo:400:kworker.0 00010000:00010000:0.0:1787579380.128022:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579380.196597:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787579380.196621:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec17c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616857728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787579380.196690:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579380.196756:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616857728 00000100:00100000:2.0:1787579380.196763:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616857728 00000100:00100000:2.0:1787579380.196808:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787579380.196816:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec17c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616857728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787579380.196854:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579380.196897:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec17c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616857728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579380.196903:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1787579380.196956:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec17c7b80 x1874412616857728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579380.196972:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec17c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616857728:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787579381.152374:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787579381.604630:0:11196:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff870fea60 20000000:00000080:1.0:1787579381.604647:0:11196:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0cebf16e400 uarg=0000000000000000 20000000:01000000:1.0:1787579381.604682:0:11196:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787579381.604687:0:11196:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787579381.604691:0:11196:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787579381.617325:0:11197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787579381.617548:0:11196:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787579381.627539:0:11196:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787579381.631858:0:11196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0ceb3f79200/0xb72beeaffa1b6e02 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579381.631882:0:11196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ce813fca00/0xb72beeaffa1b6da7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce61 expref: 12 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579381.631891:0:11196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6db5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6dae expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579381.631898:0:11196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ceb3f78a00/0xb72beeaffa1b6dc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6dbc expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579381.631923:0:11196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ce8148ac00/0xb72beeaffa1b6dd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6dca expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579381.631957:0:11196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ce8148ba00/0xb72beeaffa1b6de6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce99 expref: 12 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579381.631965:0:11196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0ceb3f79200/0xb72beeaffa1b6e02 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579381.632007:0:11196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ce8148ba00/0xb72beeaffa1b6de6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce99 expref: 12 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579381.632023:0:11196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0ce8148ba00/0xb72beeaffa1b6de6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce99 expref: 12 pid: 5860 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579381.632038:0:11196:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba810700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1874412616857856:192.168.206.53@tcp:104: 00010000:00010000:0.0:1787579381.632141:0:11196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ce8148ac00/0xb72beeaffa1b6dd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b6dca expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579381.632150:0:11196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0ce8148ac00/0xb72beeaffa1b6dd1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b6dca expref: 18 pid: 5860 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579381.632170:0:11196:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba812d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1874412616857984:0@lo:104: 00000100:00100000:0.0:1787579381.632208:0:11196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787579381.632241:0:11196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ceb3f78a00/0xb72beeaffa1b6dc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b6dbc expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579381.632250:0:11196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0ceb3f78a00/0xb72beeaffa1b6dc3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b6dbc expref: 18 pid: 5860 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579381.632267:0:11196:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba812680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1874412616858112:0@lo:104: 00000100:00100000:0.0:1787579381.632570:0:11196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787579381.632607:0:11196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6db5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b6dae expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579381.632616:0:11196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6db5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b6dae expref: 18 pid: 5860 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579381.632625:0:11196:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba811880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1874412616858240:0@lo:104: 00000100:00100000:0.0:1787579381.632648:0:11196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787579381.632667:0:11196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ce813fca00/0xb72beeaffa1b6da7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce61 expref: 12 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579381.632676:0:11196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0ce813fca00/0xb72beeaffa1b6da7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce61 expref: 12 pid: 5859 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579381.632684:0:11196:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba813480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1874412616858368:192.168.206.53@tcp:104: 00000100:00100000:0.0:1787579381.632708:0:11196:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce98663780 going to sleep for 11 seconds 00000100:00100000:3.0:1787579381.632774:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616857984 00000100:00100000:3.0:1787579381.632782:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616857984 00000100:00100000:3.0:1787579381.632816:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616858112 00000100:00100000:3.0:1787579381.632820:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616858112 00000100:00100000:3.0:1787579381.632830:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616858240 00000100:00100000:3.0:1787579381.632833:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616858240 00000100:00100000:3.0:1787579381.632848:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787579381.632865:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba813800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+5:11196:x1874412616857984:12345-0@lo:104: 00010000:00010000:3.0:1787579381.632877:0:5848:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6dca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6dd1 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.632965:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787579381.632971:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba813800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+5:11196:x1874412616857984:12345-0@lo:104: Request processed in 109us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579381.632978:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787579381.632997:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787579381.633003:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba810e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+4:11196:x1874412616858112:12345-0@lo:104: 00010000:00010000:3.0:1787579381.633012:0:5848:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6dbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6dc3 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.633046:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787579381.633052:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba810e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+4:11196:x1874412616858112:12345-0@lo:104: Request processed in 49us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579381.633057:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787579381.633069:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787579381.633076:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba810380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+3:11196:x1874412616858240:12345-0@lo:104: 00010000:00010000:3.0:1787579381.633083:0:5848:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f78e00/0xb72beeaffa1b6dae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6db5 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.633115:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787579381.633120:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba810380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+3:11196:x1874412616858240:12345-0@lo:104: Request processed in 45us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579381.633126:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1787579381.633141:0:8475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787579381.633153:0:8475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6dca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6dd1 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.633172:0:8475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148bc00 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:3.0:1787579381.633175:0:8475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6dca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b6dd1 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.633183:0:8475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6dca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b6dd1 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787579381.633190:0:8475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6dca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b6dd1 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579381.633196:0:8475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787579381.633222:0:8475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6dca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6dd1 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.633229:0:8475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787579381.633248:0:8475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6dca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6dd1 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.633255:0:8475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce8148bc00/0xb72beeaffa1b6dca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6dd1 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.633267:0:8475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787579381.633271:0:8475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6dbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6dc3 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.633276:0:8475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8152e200 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:3.0:1787579381.633279:0:8475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6dbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b6dc3 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.633295:0:8475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6dbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b6dc3 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787579381.633302:0:8475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6dbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b6dc3 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579381.633307:0:8475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787579381.633321:0:8475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6dbc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6dc3 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.633327:0:8475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787579381.633341:0:8475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6dbc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6dc3 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.633347:0:8475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce8152e200/0xb72beeaffa1b6dbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6dc3 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.633357:0:8475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787579381.633360:0:8475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f78e00/0xb72beeaffa1b6dae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6db5 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.633365:0:8475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb3f78e00 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:3.0:1787579381.633368:0:8475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f78e00/0xb72beeaffa1b6dae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b6db5 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.633375:0:8475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f78e00/0xb72beeaffa1b6dae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b6db5 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787579381.633381:0:8475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f78e00/0xb72beeaffa1b6dae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b6db5 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579381.633392:0:8475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787579381.633408:0:8475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f78e00/0xb72beeaffa1b6dae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6db5 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.633414:0:8475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787579381.633421:0:8475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f78e00/0xb72beeaffa1b6dae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6db5 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.633427:0:8475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f78e00/0xb72beeaffa1b6dae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6db5 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.633440:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579381.633442:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579381.633444:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579381.633451:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579381.633457:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579381.633463:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787579381.633474:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616858496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787579381.633503:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579381.633534:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616858752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787579381.633559:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579381.633578:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787579381.633583:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616858624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787579381.633603:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579381.633625:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616858496 00000100:00100000:3.0:1787579381.633629:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616858496 00010000:00010000:3.0:1787579381.633647:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ce8148ac00/0xb72beeaffa1b6dd1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6dca expref: 19 pid: 5860 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579381.633679:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616858752 00000100:00100000:3.0:1787579381.633682:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616858752 00010000:00010000:3.0:1787579381.633695:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6db5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6dae expref: 20 pid: 5860 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579381.633705:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616858624 00000100:00100000:3.0:1787579381.633707:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616858624 00010000:00010000:3.0:1787579381.633716:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ceb3f78a00/0xb72beeaffa1b6dc3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6dbc expref: 21 pid: 5860 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579381.633729:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787579381.633735:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4463800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+21:3321:x1874412616858496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787579381.633744:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579381.633750:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ce8148ac00/0xb72beeaffa1b6dd1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6dca expref: 21 pid: 5860 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.633759:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ce8148ac00/0xb72beeaffa1b6dd1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b6dca expref: 21 pid: 5860 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.633774:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579381.633804:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4463800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+21:3321:x1874412616858496:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579381.633810:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787579381.633824:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787579381.633830:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce90ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+20:3320:x1874412616858752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787579381.633838:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579381.633843:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6db5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6dae expref: 20 pid: 5860 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.633863:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6db5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b6dae expref: 20 pid: 5860 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.633874:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579381.633901:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce90ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+20:3320:x1874412616858752:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579381.633908:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787579381.633964:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787579381.633971:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4462300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3320:x1874412616858624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787579381.633978:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579381.633982:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ceb3f78a00/0xb72beeaffa1b6dc3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6dbc expref: 19 pid: 5860 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.633991:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ceb3f78a00/0xb72beeaffa1b6dc3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b6dbc expref: 19 pid: 5860 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.634000:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579381.634023:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4462300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3320:x1874412616858624:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579381.634029:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787579381.634063:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616858496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787579381.634086:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616858624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787579381.634093:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616858752:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787579381.634625:0:11196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce8148ac00/0xb72beeaffa1b6dd1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b6dca expref: 18 pid: 5860 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579381.634637:0:11196:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba812d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1874412616857984:0@lo:104: 00010000:00010000:0.0:1787579381.634648:0:11196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ceb3f78a00/0xb72beeaffa1b6dc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b6dbc expref: 17 pid: 5860 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579381.634655:0:11196:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba812680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1874412616858112:0@lo:104: 00010000:00010000:0.0:1787579381.634663:0:11196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6db5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b6dae expref: 16 pid: 5860 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579381.634680:0:11196:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba811880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1874412616858240:0@lo:104: 00000100:00100000:2.0:1787579381.638517:0:11196:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba810700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1874412616857856:192.168.206.53@tcp:104: 00000100:00100000:2.0:1787579381.638534:0:11196:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba813480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1874412616858368:192.168.206.53@tcp:104: 00010000:00010000:2.0:1787579381.638564:0:11196:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0ceb3f79200/0xb72beeaffa1b6e02 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579381.638829:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579381.639014:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591659648 00000100:00100000:3.0:1787579381.639021:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591659648 00010000:00010000:3.0:1787579381.639055:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ce8148ba00/0xb72beeaffa1b6de6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce99 expref: 13 pid: 5860 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579381.639098:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 28 00000100:00100000:3.0:1787579381.639108:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:803d6039-c137-4d52-85de-c5895e5f2411+13:2361:x1874412591659648:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787579381.639123:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579381.639129:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ce8148ba00/0xb72beeaffa1b6de6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce99 expref: 13 pid: 5860 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.639141:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ce8148ba00/0xb72beeaffa1b6de6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce99 expref: 13 pid: 5860 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.639169:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce8148ba00/0xb72beeaffa1b6de6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce99 expref: 13 pid: 5860 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.639185:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579381.639235:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:803d6039-c137-4d52-85de-c5895e5f2411+12:2361:x1874412591659648:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 128us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579381.639242:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 28 00000100:00100000:1.0:1787579381.639690:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579381.639745:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591659776 00000100:00100000:3.0:1787579381.639750:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591659776 00010000:00010000:3.0:1787579381.639767:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ce813fca00/0xb72beeaffa1b6da7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce61 expref: 12 pid: 5859 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579381.639793:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 29 00000100:00100000:3.0:1787579381.639811:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:803d6039-c137-4d52-85de-c5895e5f2411+12:2362:x1874412591659776:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787579381.639820:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579381.639826:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ce813fca00/0xb72beeaffa1b6da7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce61 expref: 12 pid: 5859 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.639846:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ce813fca00/0xb72beeaffa1b6da7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce61 expref: 12 pid: 5859 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.639856:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce813fca00/0xb72beeaffa1b6da7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce61 expref: 12 pid: 5859 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.639868:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0ceb3f79200/0xb72beeaffa1b6e02 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.639876:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceb3f79200/0xb72beeaffa1b6e02 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.639889:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0ceb3f79200/0xb72beeaffa1b6e02 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.639896:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0ceb3f79200/0xb72beeaffa1b6e02 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.639903:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0ceb3f79200/0xb72beeaffa1b6e02 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.639909:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0ceb3f79200/0xb72beeaffa1b6e02 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.639915:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb3f79200 already unused, calling callback (ffffffffc1654230) 00010000:00010000:3.0:1787579381.639919:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0ceb3f79200/0xb72beeaffa1b6e02 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.639960:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0ceb3f79200/0xb72beeaffa1b6e02 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.639984:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0ceb3f79200/0xb72beeaffa1b6e02 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579381.639993:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579381.640021:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:803d6039-c137-4d52-85de-c5895e5f2411+11:2362:x1874412591659776:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 220us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579381.640028:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 29 00010000:00010000:1.0:1787579381.640240:0:11196:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0ceb3f79200/0xb72beeaffa1b6e02 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579381.640249:0:11196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0ceb3f79200/0xb72beeaffa1b6e02 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579381.640255:0:11196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ceb3f79200/0xb72beeaffa1b6e02 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579382.179790:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579383.200157:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787579383.329103:0:5863:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787579383.329121:0:5863:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0ceb3138000 from 7 10000000:01000000:2.0:1787579383.329126:0:5863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787579383.329183:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b6e09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579383.329206:0:5863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b6e09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579383.329218:0:5863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b6e09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579383.329242:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec17c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616858880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787579383.329304:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579383.329356:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fbd780 going to sleep for 11 seconds 00000100:00100000:3.0:1787579383.329463:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616858880 00000100:00100000:3.0:1787579383.329471:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616858880 00000100:00100000:3.0:1787579383.329525:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787579383.329535:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:5863:x1874412616858880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787579383.329547:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579383.329561:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce8152e200/0xb72beeaffa1b6e10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6e09 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579383.329593:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce8152e200/0xb72beeaffa1b6e10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6e09 expref: 17 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579383.329603:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce8152e200/0xb72beeaffa1b6e10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6e09 expref: 17 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579383.329612:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8152e200, rc 0) 00000100:00100000:3.0:1787579383.329661:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616858880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579383.329668:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787579383.329881:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec17c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616858880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787579383.329896:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b6e09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6e10 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579383.329905:0:5863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b6e09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6e10 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579383.329986:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec17c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616859008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787579383.330013:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579383.330036:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fbd780 going to sleep for 11 seconds 00000100:00100000:3.0:1787579383.330128:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616859008 00000100:00100000:3.0:1787579383.330132:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616859008 00000100:00100000:3.0:1787579383.332282:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787579383.332302:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616859008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787579383.332613:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616859008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 319us (2598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579383.332621:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787579383.332819:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec17c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616859008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787579383.332868:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebfa57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616859136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787579383.332915:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579383.338318:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616859136 00000100:00100000:0.0:1787579383.338332:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616859136 00000100:00100000:1.0:1787579383.338372:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce986d5240 going to sleep for 11 seconds 00000100:00100000:0.0:1787579383.338384:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787579383.338394:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616859136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787579383.338614:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616859136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 222us (5699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579383.338622:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787579383.339445:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebfa57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616859136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787579383.346604:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000040:00080000:3.0:1787579383.347233:0:11285:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000100:00100000:0.0:1787579383.347548:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591659904 00000100:00100000:0.0:1787579383.347558:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591659904 00000100:00100000:0.0:1787579383.347610:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 231 00000100:00100000:0.0:1787579383.347620:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+11:5603:x1874412591659904:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787579383.347634:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579383.347649:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceb3f78c00/0xb72beeaffa1b6e17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cec3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579383.347674:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceb3f78c00/0xb72beeaffa1b6e17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cec3 expref: 12 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579383.347685:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceb3f78c00/0xb72beeaffa1b6e17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cec3 expref: 12 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579383.347695:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb3f78c00, rc 0) 00000100:00100000:0.0:1787579383.347746:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+12:5603:x1874412591659904:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 Request processed in 127us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579383.347763:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 231 00000020:01000000:3.0:1787579383.348769:0:5863:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787579383.348793:0:5863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787579383.348802:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b6e09 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6e10 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579383.348813:0:5863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b6e09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6e10 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579383.348822:0:5863:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787579383.348824:0:5863:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0ce84eda800 from 7 10000000:01000000:3.0:1787579383.348827:0:5863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787579383.348983:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f000/0xb72beeaffa1b6e1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579383.348992:0:5863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f000/0xb72beeaffa1b6e1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579383.349002:0:5863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f000/0xb72beeaffa1b6e1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579383.349024:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4462680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616859264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787579383.349072:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579383.349114:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb448c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787579383.349134:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616859264 00000100:00100000:3.0:1787579383.349140:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616859264 00000100:00100000:3.0:1787579383.349182:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787579383.349190:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616859264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787579383.349200:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579383.349210:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce8152ea00/0xb72beeaffa1b6e25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6e1e expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579383.349228:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce8152ea00/0xb72beeaffa1b6e25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6e1e expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579383.349238:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce8152ea00/0xb72beeaffa1b6e25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6e1e expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579383.349246:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8152ea00, rc 0) 00000100:00100000:3.0:1787579383.349279:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616859264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579383.349285:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787579383.349396:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4462680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616859264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787579383.349409:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f000/0xb72beeaffa1b6e1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6e25 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579383.349418:0:5863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f000/0xb72beeaffa1b6e1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6e25 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579383.349472:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4462680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616859392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787579383.349501:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579383.349530:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb448c300 going to sleep for 11 seconds 00000100:00100000:0.0:1787579383.349706:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616859392 00000100:00100000:0.0:1787579383.349711:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616859392 00000100:00100000:0.0:1787579383.349748:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787579383.349755:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616859392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579383.350076:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616859392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 320us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579383.350084:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787579383.350184:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4462680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616859392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787579383.350214:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4462680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616859520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787579383.350253:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579383.350267:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb448c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787579383.350280:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616859520 00000100:00100000:3.0:1787579383.350283:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616859520 00000100:00100000:3.0:1787579383.352258:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787579383.352274:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616859520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787579383.352663:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579383.354053:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616859520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1780us (3795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579383.354065:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787579383.356483:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591660032 00000100:00100000:3.0:1787579383.356496:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591660032 00000100:00100000:1.0:1787579383.356745:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 235 00000100:00100000:1.0:1787579383.356758:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+12:5603:x1874412591660032:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787579383.357099:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+12:5603:x1874412591660032:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 Request processed in 343us (4530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579383.358203:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 235 00000100:00100000:2.0:1787579383.359612:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4462680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616859520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787579383.361769:0:11287:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787579383.362460:0:5863:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787579383.362493:0:5863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787579383.362504:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f000/0xb72beeaffa1b6e1e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6e25 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579383.362532:0:5863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f000/0xb72beeaffa1b6e1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6e25 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579383.362542:0:5863:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787579383.362545:0:5863:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0ce90be4800 from 7 10000000:01000000:2.0:1787579383.362547:0:5863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787579383.362591:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba319200/0xb72beeaffa1b6e2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579383.362598:0:5863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ceba319200/0xb72beeaffa1b6e2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579383.362607:0:5863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ceba319200/0xb72beeaffa1b6e2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579383.362629:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec17c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616859648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787579383.362686:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579383.362720:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fbdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787579383.363043:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579383.363068:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616859648 00000100:00100000:3.0:1787579383.363074:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616859648 00000100:00100000:3.0:1787579383.363116:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591660160 00000100:00100000:3.0:1787579383.363119:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591660160 00000100:00100000:3.0:1787579383.363136:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787579383.363144:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616859648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787579383.363174:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1787579383.363174:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 237 00000100:00100000:1.0:1787579383.363187:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+12:5603:x1874412591660160:12345-192.168.206.53@tcp:503:ll_cfg_requeue.0 00010000:00010000:3.0:1787579383.363189:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce8152e600/0xb72beeaffa1b6e33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6e2c expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579383.363212:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce8152e600/0xb72beeaffa1b6e33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6e2c expref: 19 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579383.363236:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce8152e600/0xb72beeaffa1b6e33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6e2c expref: 19 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579383.363244:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8152e600, rc 0) 00000100:00100000:3.0:1787579383.363284:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:5863:x1874412616859648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579383.363292:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787579383.363391:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+12:5603:x1874412591660160:12345-192.168.206.53@tcp:503:ll_cfg_requeue.0 Request processed in 206us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579383.363398:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 237 00000100:00100000:2.0:1787579383.364775:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec17c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616859648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787579383.364796:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ceba319200/0xb72beeaffa1b6e2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6e33 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579383.364808:0:5863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ceba319200/0xb72beeaffa1b6e2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6e33 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579383.364873:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec17c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616859776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787579383.364916:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579383.365025:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fbdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787579383.365671:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616859776 00000100:00100000:3.0:1787579383.365678:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616859776 00000100:00100000:3.0:1787579383.365770:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787579383.365778:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:5863:x1874412616859776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787579383.366593:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:5863:x1874412616859776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 812us (1674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579383.366603:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787579383.371114:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579383.371163:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591660288 00000100:00100000:0.0:1787579383.371173:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591660288 00000100:00100000:0.0:1787579383.371221:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 239 00000100:00100000:0.0:1787579383.371231:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+12:5603:x1874412591660288:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787579383.371246:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579383.371268:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceb3f79400/0xb72beeaffa1b6e3a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01ceca expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579383.371294:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceb3f79400/0xb72beeaffa1b6e3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ceca expref: 13 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579383.371305:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceb3f79400/0xb72beeaffa1b6e3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ceca expref: 13 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579383.371314:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb3f79400, rc 0) 00000100:00100000:0.0:1787579383.371380:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+13:5603:x1874412591660288:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 Request processed in 150us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579383.371397:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 239 00000100:00100000:1.0:1787579383.380087:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec17c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616859776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787579383.380166:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebfa57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616859904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787579383.380238:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579383.380667:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce986d56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787579383.381512:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616859904 00000100:00100000:0.0:1787579383.381521:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616859904 00000100:00100000:0.0:1787579383.381565:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787579383.381586:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:5863:x1874412616859904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787579383.381785:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:5863:x1874412616859904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 212us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579383.381794:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787579383.381850:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebfa57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616859904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787579383.382761:0:11288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787579383.382826:0:5863:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787579383.382842:0:5863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787579383.382852:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba319200/0xb72beeaffa1b6e2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6e33 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579383.382861:0:5863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ceba319200/0xb72beeaffa1b6e2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6e33 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579383.387027:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579383.388165:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591660416 00000100:00100000:0.0:1787579383.388177:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591660416 00000100:00100000:0.0:1787579383.388230:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 241 00000100:00100000:0.0:1787579383.388239:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+13:5603:x1874412591660416:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579383.388506:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+13:5603:x1874412591660416:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 Request processed in 266us (1485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579383.388514:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 241 00000100:00100000:0.0:1787579383.396820:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579383.396884:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591660544 00000100:00100000:1.0:1787579383.396904:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591660544 00000100:00100000:1.0:1787579383.396976:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 242 00000100:00100000:1.0:1787579383.396985:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+13:5603:x1874412591660544:12345-192.168.206.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787579383.397190:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+13:5603:x1874412591660544:12345-192.168.206.53@tcp:503:ll_cfg_requeue.0 Request processed in 205us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579383.397198:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 242 00010000:00010000:0.0:1787579384.226244:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579384.497556:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579384.497597:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579384.497622:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579384.497651:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591660672 00000100:00100000:0.0:1787579384.497660:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591660672 00000100:00100000:0.0:1787579384.497714:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 243 00000100:00100000:0.0:1787579384.497724:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+13:2362:x1874412591660672:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579384.497802:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+13:2362:x1874412591660672:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 80us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579384.497810:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 243 00000100:00100000:0.0:1787579384.498009:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591660800 00000100:00100000:0.0:1787579384.498014:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591660800 00000100:00100000:0.0:1787579384.498049:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591660928 00000100:00100000:0.0:1787579384.498052:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591660928 00000100:00100000:0.0:1787579384.498073:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 85 00000100:00100000:0.0:1787579384.498080:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+6:2362:x1874412591660800:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579384.498112:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+6:2362:x1874412591660800:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 33us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579384.498119:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 85 00000100:00100000:0.0:1787579384.498131:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 86 00000100:00100000:0.0:1787579384.498138:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2362:x1874412591660928:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579384.498172:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2362:x1874412591660928:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 35us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579384.498178:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 86 00000100:00080000:0.0:1787579384.498296:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579384.800168:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba810a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3322:1874412616860160:0@lo:400:kworker.0 00000100:00100000:0.0:1787579384.800232:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579384.800279:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba810700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3322:1874412616860672:0@lo:400:kworker.0 00000100:00100000:0.0:1787579384.800302:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579384.800330:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787579384.800336:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba811180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616860032:0@lo:400:kworker.0 00000100:00100000:0.0:1787579384.800365:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579384.800397:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616860544:0@lo:400:kworker.0 00000100:00100000:0.0:1787579384.800421:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579384.800447:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616860288:0@lo:400:kworker.0 00000100:00100000:0.0:1787579384.800469:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579384.800487:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787579384.800492:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616860416:0@lo:400:kworker.0 00000100:00100000:0.0:1787579384.800512:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579384.800539:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616860160 00000100:00100000:0.0:1787579384.800547:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616860160 00000100:00100000:0.0:1787579384.800582:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616860672 00000100:00100000:0.0:1787579384.800585:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616860672 00000100:00100000:0.0:1787579384.800758:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616860288 00000100:00100000:0.0:1787579384.800762:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616860288 00000100:00100000:0.0:1787579384.800786:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787579384.800794:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1874412616860160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579384.800843:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1874412616860160:12345-0@lo:400:kworker.0 Request processed in 49us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579384.800849:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787579384.800864:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787579384.800879:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1874412616860672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579384.801003:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1874412616860672:12345-0@lo:400:kworker.0 Request processed in 125us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579384.801009:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787579384.801022:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787579384.801028:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616860288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579384.801058:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616860288:12345-0@lo:400:kworker.0 Request processed in 30us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579384.801064:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787579384.801082:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616860032 00000100:00100000:0.0:1787579384.801086:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616860032 00000100:00100000:0.0:1787579384.801110:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787579384.801116:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3322:x1874412616860032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579384.801158:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3322:x1874412616860032:12345-0@lo:400:kworker.0 Request processed in 41us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579384.801165:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787579384.801191:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616860544 00000100:00100000:0.0:1787579384.801195:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616860544 00000100:00100000:0.0:1787579384.801221:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616860416 00000100:00100000:0.0:1787579384.801224:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616860416 00000100:00100000:0.0:1787579384.801244:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787579384.801250:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616860544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579384.801279:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616860544:12345-0@lo:400:kworker.0 Request processed in 29us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579384.801284:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787579384.801295:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787579384.801301:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616860416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579384.801336:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616860416:12345-0@lo:400:kworker.0 Request processed in 36us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579384.801342:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1787579384.801363:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787579384.801367:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787579384.801435:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787579384.801473:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceba811f80 x1874412616860416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579384.801485:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616860416:0@lo:400:kworker.0 00000100:00100000:0.0:1787579384.801495:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616860288:0@lo:400:kworker.0 00000100:00100000:0.0:1787579384.801528:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba811180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616860032:0@lo:400:kworker.0 00010000:00080000:0.0:1787579384.801538:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceba813480 x1874412616860544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579384.801710:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616860544:0@lo:400:kworker.0 00000100:00100000:0.0:1787579384.801726:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba810a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3322:1874412616860160:0@lo:400:kworker.0 00000100:00100000:0.0:1787579384.801735:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba810700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3322:1874412616860672:0@lo:400:kworker.0 00000100:00100000:3.0:1787579384.804262:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787579384.804280:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616860800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787579384.804337:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579384.804380:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616860800 00000100:00100000:3.0:1787579384.804387:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616860800 00000100:00100000:3.0:1787579384.804431:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787579384.804440:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616860800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787579384.804472:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787579384.804512:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616860800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579384.804520:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787579384.804557:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceb4460380 x1874412616860800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579384.804583:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616860800:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1787579385.102632:0:11395:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg653-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787579385.252973:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579385.312163:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787579385.312200:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec17c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616860928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787579385.312272:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579385.312483:0:7952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616860928 00000100:00100000:2.0:1787579385.312491:0:7952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616860928 00000100:00100000:2.0:1787579385.312542:0:7952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787579385.312552:0:7952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616860928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787579385.312593:0:7952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579385.312656:0:7952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616860928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579385.312664:0:7952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1787579385.312964:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec17c4a80 x1874412616860928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579385.312983:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec17c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616860928:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787579386.272086:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579387.299869:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579388.326063:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787579388.735181:0:11494:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 09:49:46 (1787579386) === 00000100:00100000:1.0:1787579388.936958:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579388.936996:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579388.937080:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591661056 00000100:00100000:0.0:1787579388.937091:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591661056 00000100:00100000:0.0:1787579388.937173:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 14 00000100:00100000:0.0:1787579388.937184:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+6:2359:x1874412591661056:12345-192.168.206.53@tcp:41:mkdir.0 00000004:00000024:0.0:1787579388.937235:0:5866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787579388.937312:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+6:2359:x1874412591661056:12345-192.168.206.53@tcp:41:mkdir.0 Request processed in 130us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579388.937320:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 14 00000100:00080000:1.0:1787579388.937568:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787579388.937743:0:5875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591661184 00000100:00100000:2.0:1787579388.937751:0:5875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591661184 00000100:00100000:2.0:1787579388.937777:0:5875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:2.0:1787579388.937784:0:5875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:963d8c17-1326-491b-be60-9002b9296555+6:9698:x1874412591661184:12345-192.168.206.53@tcp:700:mkdir.0 00000100:00100000:2.0:1787579388.937875:0:5875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:963d8c17-1326-491b-be60-9002b9296555+6:9698:x1874412591661184:12345-192.168.206.53@tcp:700:mkdir.0 Request processed in 91us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579388.937882:0:5875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:1.0:1787579388.947857:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579388.947999:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591661440 00000100:00100000:0.0:1787579388.948008:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591661440 00000100:00100000:0.0:1787579388.948064:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 15 00000100:00100000:0.0:1787579388.948074:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+6:9698:x1874412591661440:12345-192.168.206.53@tcp:36:mkdir.0 00010000:00010000:0.0:1787579388.948135:0:5867:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579388.948168:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b6d22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce4c expref: 6 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579388.948190:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0cea147d500) 00010000:00010000:0.0:1787579388.948200:0:5867:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787579388.948694:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78600/0xb72beeaffa1b6e41 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579388.948709:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78600/0xb72beeaffa1b6e41 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579388.948719:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78600/0xb72beeaffa1b6e41 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579388.948731:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78000/0xb72beeaffa1b6e48 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579388.948738:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78000/0xb72beeaffa1b6e48 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579388.948757:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78000/0xb72beeaffa1b6e48 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787579388.954705:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787579388.954723:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78600/0xb72beeaffa1b6e41 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579388.954734:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78600/0xb72beeaffa1b6e41 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579388.954742:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78600/0xb72beeaffa1b6e41 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579388.954748:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb3f78600 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579388.954752:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78600/0xb72beeaffa1b6e41 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579388.954770:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78600/0xb72beeaffa1b6e41 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579388.954788:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce82cbb400) 00010000:00010000:1.0:1787579388.954791:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579388.954796:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78600/0xb72beeaffa1b6e41 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579388.954802:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78600/0xb72beeaffa1b6e41 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787579388.954820:0:5867:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a2d34b2 reply state 00000000783803be transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78000/0xb72beeaffa1b6e48 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579388.954829:0:5867:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787579388.963012:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+7:9698:x1874412591661440:12345-192.168.206.53@tcp:36:mkdir.0 Request processed in 14927us (15150us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787579388.963026:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 15 00010000:00010000:2.0:1787579388.966957:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78000/0xb72beeaffa1b6e48 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579388.966975:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78000/0xb72beeaffa1b6e48 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579388.966984:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78000/0xb72beeaffa1b6e48 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579388.966990:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb3f78000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579388.966994:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78000/0xb72beeaffa1b6e48 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579388.967015:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78000/0xb72beeaffa1b6e48 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579388.967032:0:3305:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa0ce82cbb100) 00010000:00010000:2.0:1787579388.967035:0:3305:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579388.967040:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78000/0xb72beeaffa1b6e48 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579388.967047:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78000/0xb72beeaffa1b6e48 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579388.982667:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579388.983225:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591661568 00000100:00100000:3.0:1787579388.983241:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591661568 00000100:00100000:3.0:1787579388.983320:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00100000:3.0:1787579388.983332:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+6:9700:x1874412591661568:12345-192.168.206.53@tcp:101:chmod.0 00010000:00010000:3.0:1787579388.983364:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579388.983401:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b6e4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01ced1 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579388.983491:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e400/0xb72beeaffa1b6e56 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579388.983507:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e400/0xb72beeaffa1b6e56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579388.983521:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e400/0xb72beeaffa1b6e56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579388.983598:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787579388.983603:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787579388.983648:0:5868:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e400/0xb72beeaffa1b6e56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579388.983679:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b6e4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ced1 expref: 8 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579388.983704:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e400/0xb72beeaffa1b6e56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ced1 expref: 7 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579388.983734:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:3.0:1787579388.983737:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787579388.983742:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8152e400, rc 0) 00000100:00100000:3.0:1787579388.983835:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+7:9700:x1874412591661568:12345-192.168.206.53@tcp:101:chmod.0 Request processed in 505us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579388.983843:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00100000:0.0:1787579388.987711:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579388.993381:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591661824 00000100:00100000:3.0:1787579388.993395:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591661824 00000100:00100000:3.0:1787579388.993463:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 17 00000100:00100000:3.0:1787579388.993473:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+7:9700:x1874412591661824:12345-192.168.206.53@tcp:36:chmod.0 00010000:00010000:3.0:1787579388.993533:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579388.993559:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e400/0xb72beeaffa1b6e56 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ced1 expref: 7 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579388.993581:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:3.0:1787579388.993591:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787579388.993616:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b6e5d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579388.993627:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b6e5d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579388.993636:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b6e5d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787579388.993919:0:9532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064842e7b reply state 00000000f6c89e2d transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b6e5d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579388.993970:0:9532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787579388.993986:0:9532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787579388.994060:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+8:9700:x1874412591661824:12345-192.168.206.53@tcp:36:chmod.0 Request processed in 588us (6357us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787579388.994067:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 17 00010000:00010000:1.0:1787579389.000066:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b6e5d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579389.000083:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b6e5d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579389.000090:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b6e5d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579389.000095:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce813fde00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579389.000100:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b6e5d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579389.000107:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b6e5d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579389.000153:0:3306:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:1.0:1787579389.000156:0:3306:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787579389.000161:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b6e5d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579389.000168:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b6e5d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579389.027071:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579389.027744:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591661952 00000100:00100000:2.0:1787579389.027758:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591661952 00000100:00100000:2.0:1787579389.027873:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 18 00000100:00100000:2.0:1787579389.027884:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+7:9701:x1874412591661952:12345-192.168.206.53@tcp:101:chown.0 00010000:00010000:2.0:1787579389.027906:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579389.027975:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318200/0xb72beeaffa1b6e64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01ced8 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.028042:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b6e6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.028055:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b6e6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.028066:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b6e6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579389.028139:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787579389.028156:0:5867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787579389.028203:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b6e6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.028232:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318200/0xb72beeaffa1b6e64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ced8 expref: 9 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.028249:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b6e6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ced8 expref: 8 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.028258:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0cea147d700) 00010000:00010000:2.0:1787579389.028261:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787579389.028265:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba318c00, rc 0) 00000100:00100000:2.0:1787579389.028341:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+8:9701:x1874412591661952:12345-192.168.206.53@tcp:101:chown.0 Request processed in 458us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579389.028348:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 18 00000100:00100000:0.0:1787579389.034853:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579389.035029:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591662080 00000100:00100000:2.0:1787579389.035038:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591662080 00000100:00100000:2.0:1787579389.035102:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 19 00000100:00100000:2.0:1787579389.035113:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+8:9701:x1874412591662080:12345-192.168.206.53@tcp:101:chown.0 00010000:00010000:2.0:1787579389.035147:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579389.035167:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b6e72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cedf expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.035228:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6e79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.035242:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6e79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.035268:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6e79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.035284:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b6e80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.035292:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b6e80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.035298:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b6e80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.035389:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b6e87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.035397:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b6e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.035404:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b6e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579389.035439:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787579389.035444:0:5867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787579389.035466:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b6e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.036688:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6e79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.036699:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6e79 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.036721:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6e79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.036727:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579389.036731:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6e79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.036738:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6e79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.036752:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0cea147d700) 00010000:00010000:2.0:1787579389.036755:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579389.036760:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6e79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.036767:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6e79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.036780:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b6e80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.036786:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b6e80 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.036792:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b6e80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.036797:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba319800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579389.036800:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b6e80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.036819:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b6e80 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.036829:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa0cea147d400) 00010000:00010000:2.0:1787579389.036831:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579389.036835:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b6e80 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.036840:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b6e80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.036877:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b6e72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cedf expref: 10 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.036891:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b6e87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cedf expref: 9 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.036899:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0cea147dc00) 00010000:00010000:2.0:1787579389.036901:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787579389.036904:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319c00, rc 0) 00000100:00100000:2.0:1787579389.038012:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+9:9701:x1874412591662080:12345-192.168.206.53@tcp:101:chown.0 Request processed in 2896us (3162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579389.038023:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 19 00000100:00100000:1.0:1787579389.047240:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579389.047317:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591662336 00000100:00100000:3.0:1787579389.047335:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591662336 00000100:00100000:3.0:1787579389.047419:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 20 00000100:00100000:3.0:1787579389.047433:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+9:9701:x1874412591662336:12345-192.168.206.53@tcp:36:chown.0 00010000:00010000:3.0:1787579389.047505:0:9530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579389.047540:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b6e87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cedf expref: 9 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579389.047563:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0cea147dc00) 00010000:00010000:3.0:1787579389.047577:0:9530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787579389.047611:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b6e8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579389.047627:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b6e8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579389.047638:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b6e8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787579389.205967:0:5888:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:0.0:1787579389.205980:0:5888:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1787579389.206179:0:9530:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002fcaf27 reply state 0000000055545689 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b6e8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579389.206193:0:9530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787579389.206335:0:9530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1787579389.206448:0:9530:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787579389.206466:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+7:9701:x1874412591662336:12345-192.168.206.53@tcp:36:chown.0 Request processed in 159033us (159230us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787579389.206474:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 20 00010000:00010000:2.0:1787579389.206513:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b6e8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.206522:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b6e8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.206529:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b6e8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.206534:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce813fca00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579389.206538:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b6e8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.206545:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b6e8e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.206569:0:3305:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:2.0:1787579389.206572:0:3305:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787579389.206577:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b6e8e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.206583:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b6e8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579389.230868:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579389.230961:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591662464 00000100:00100000:3.0:1787579389.230970:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591662464 00000100:00100000:3.0:1787579389.231022:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 21 00000100:00100000:3.0:1787579389.231032:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+6:9702:x1874412591662464:12345-192.168.206.53@tcp:101:touch.500 00010000:00010000:3.0:1787579389.231076:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579389.231097:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fc400/0xb72beeaffa1b6e95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cee6 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787579389.237476:0:5868:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 6322us 00010000:00010000:0.0:1787579389.277682:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f79200/0xb72beeaffa1b6e9c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.277703:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f79200/0xb72beeaffa1b6e9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.277714:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f79200/0xb72beeaffa1b6e9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.277748:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78a00/0xb72beeaffa1b6ea3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.277755:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78a00/0xb72beeaffa1b6ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.277762:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78a00/0xb72beeaffa1b6ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.278536:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78400/0xb72beeaffa1b6eaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.278547:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78400/0xb72beeaffa1b6eaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.278554:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78400/0xb72beeaffa1b6eaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579389.278720:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787579389.278724:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787579389.279135:0:5868:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78400/0xb72beeaffa1b6eaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.279150:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f79200/0xb72beeaffa1b6e9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.279157:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f79200/0xb72beeaffa1b6e9c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.279164:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f79200/0xb72beeaffa1b6e9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.279176:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb3f79200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579389.279180:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f79200/0xb72beeaffa1b6e9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.279188:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f79200/0xb72beeaffa1b6e9c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.279208:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0cea147d700) 00010000:00010000:0.0:1787579389.279299:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579389.279306:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f79200/0xb72beeaffa1b6e9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.279313:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f79200/0xb72beeaffa1b6e9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.279326:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78a00/0xb72beeaffa1b6ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.279332:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78a00/0xb72beeaffa1b6ea3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.279337:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78a00/0xb72beeaffa1b6ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.279343:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb3f78a00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579389.279346:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78a00/0xb72beeaffa1b6ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.279351:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78a00/0xb72beeaffa1b6ea3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.279368:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa0ce82cbb800) 00010000:00010000:0.0:1787579389.279371:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579389.279374:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78a00/0xb72beeaffa1b6ea3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.279380:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78a00/0xb72beeaffa1b6ea3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.279430:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fc400/0xb72beeaffa1b6e95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cee6 expref: 8 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.279485:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78400/0xb72beeaffa1b6eaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cee6 expref: 7 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.279491:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:0.0:1787579389.279500:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787579389.279503:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb3f78400, rc 0) 00000100:00100000:0.0:1787579389.279591:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+7:9702:x1874412591662464:12345-192.168.206.53@tcp:101:touch.500 Request processed in 48559us (48729us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579389.279599:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 21 00000100:00100000:1.0:1787579389.295020:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579389.295220:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591662720 00000100:00100000:2.0:1787579389.295229:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591662720 00000100:00100000:2.0:1787579389.295276:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 22 00000100:00100000:2.0:1787579389.295286:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+7:9702:x1874412591662720:12345-192.168.206.53@tcp:101:touch.500 00010000:00010000:2.0:1787579389.295318:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579389.295337:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b6eb1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01ceed expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.295637:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b6eb8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.295651:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b6eb8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.295661:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b6eb8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.295708:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6ebf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.295716:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6ebf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.295723:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6ebf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787579389.297059:0:5867:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1787579389.297352:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fc400/0xb72beeaffa1b6ec6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579389.297365:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fc400/0xb72beeaffa1b6ec6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579389.297790:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fc400/0xb72beeaffa1b6ec6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579389.297829:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b6eb8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579389.297837:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b6eb8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579389.297844:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b6eb8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579389.297849:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba319800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579389.297853:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b6eb8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579389.297861:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b6eb8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579389.297872:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:3.0:1787579389.297985:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579389.297990:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b6eb8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579389.297997:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b6eb8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787579389.298010:0:5867:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005e2d78c7 reply state 00000000e75212bc transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6ebf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579389.298019:0:5867:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787579389.298591:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b6eb1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ceed expref: 10 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579389.298610:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fc400/0xb72beeaffa1b6ec6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ceed expref: 9 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579389.298617:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:3.0:1787579389.298620:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787579389.298622:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce813fc400, rc 0) 00000100:00100000:3.0:1787579389.298731:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+10:9702:x1874412591662720:12345-192.168.206.53@tcp:101:touch.500 Request processed in 3445us (3719us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787579389.298741:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 22 00010000:00010000:2.0:1787579389.309365:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6ebf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.309392:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6ebf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.309400:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6ebf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.309405:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579389.309424:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6ebf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.309431:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6ebf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.309445:0:3305:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x18cce540 (ffffa0cea147d400) 00010000:00010000:2.0:1787579389.309448:0:3305:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579389.309453:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6ebf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.309458:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6ebf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579389.330892:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579389.331155:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591662976 00000100:00100000:2.0:1787579389.331164:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591662976 00000100:00100000:2.0:1787579389.331214:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 23 00000100:00100000:2.0:1787579389.331223:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+9:9702:x1874412591662976:12345-192.168.206.53@tcp:36:touch.500 00010000:00010000:2.0:1787579389.331272:0:9530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579389.331298:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fc400/0xb72beeaffa1b6ec6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ceed expref: 9 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.331317:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:2.0:1787579389.331326:0:9530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787579389.331366:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6ed4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.331387:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6ed4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.331397:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6ed4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787579389.331516:0:9530:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f157d751 reply state 00000000494ad768 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6ed4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579389.331524:0:9530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787579389.331611:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+10:9702:x1874412591662976:12345-192.168.206.53@tcp:36:touch.500 Request processed in 388us (731us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787579389.331618:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 23 00000100:00100000:0.0:1787579389.334652:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579389.334822:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591663104 00000100:00100000:3.0:1787579389.334832:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591663104 00000100:00100000:3.0:1787579389.334891:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 24 00000100:00100000:3.0:1787579389.334901:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+10:9702:x1874412591663104:12345-192.168.206.53@tcp:101:touch.500 00010000:00010000:3.0:1787579389.334923:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579389.334972:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b6edb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cef4 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579389.335037:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b6edb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cef4 expref: 11 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579389.335057:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b6edb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cef4 expref: 11 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579389.335076:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0cea147d400) 00010000:00010000:3.0:1787579389.335079:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787579389.335083:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce813fca00, rc 0) 00000100:00100000:3.0:1787579389.335142:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+11:9702:x1874412591663104:12345-192.168.206.53@tcp:101:touch.500 Request processed in 242us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579389.335150:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 24 00010000:00010000:2.0:1787579389.335923:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6ed4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.335947:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6ed4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.335953:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6ed4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.335959:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579389.335963:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6ed4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.335970:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6ed4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.335983:0:3306:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0cea147d400) 00010000:00010000:2.0:1787579389.335986:0:3306:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579389.335990:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6ed4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579389.335996:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b6ed4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579389.339809:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579389.339906:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591663232 00000100:00100000:0.0:1787579389.339915:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591663232 00000100:00100000:0.0:1787579389.339983:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 17 00000100:00100000:0.0:1787579389.339991:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1874412591663232:12345-192.168.206.53@tcp:8:touch.500 00010000:00080000:0.0:1787579389.340021:0:6712:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 963d8c17-1326-491b-be60-9002b9296555@192.168.206.53@tcp t0 exp 0000000000000000 cur 325 last 0 00000020:00000080:0.0:1787579389.340065:0:6712:0:(genops.c:1385:class_connect()) connect: client 963d8c17-1326-491b-be60-9002b9296555, cookie 0xb72beeaffa1b6ee2 00002000:00100000:0.0:1787579389.340077:0:6712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 963d8c17-1326-491b-be60-9002b9296555/ffffa0ce85767000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787579389.340098:0:6712:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787579389.340313:0:6712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787579389.340339:0:6712:0:(import.c:65:import_set_state_nolock()) ffffa0ce85764000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787579389.340472:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+6:2358:x1874412591663232:12345-192.168.206.53@tcp:8:touch.500 Request processed in 479us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579389.340480:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 17 00010000:00010000:3.0:1787579389.344269:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579389.356231:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579389.356325:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591663360 00000100:00100000:0.0:1787579389.356346:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591663360 00000100:00100000:0.0:1787579389.356413:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 18 00000100:00100000:0.0:1787579389.356422:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+6:0:x1874412591663360:12345-192.168.206.53@tcp:2:touch.500 00000100:00080000:1.0:1787579389.356732:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787579389.470319:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:3.0:1787579389.470333:0:7670:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 963d8c17-1326-491b-be60-9002b9296555 00000100:00100000:1.0:1787579389.470602:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+5:0:x1874412591663360:12345-192.168.206.53@tcp:2:touch.500 Request processed in 114175us (114373us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787579389.470613:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 18 00000100:00100000:3.0:1787579389.474044:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579389.477981:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591663616 00000100:00100000:0.0:1787579389.477995:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591663616 00000100:00100000:0.0:1787579389.478150:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 2 00000100:00100000:0.0:1787579389.478161:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+10:9702:x1874412591663616:12345-192.168.206.53@tcp:35:touch.500 00000100:00100000:0.0:1787579389.479314:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+11:9702:x1874412591663616:12345-192.168.206.53@tcp:35:touch.500 Request processed in 1152us (5275us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787579389.479323:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 2 00000100:00100000:2.0:1787579389.509225:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579389.509474:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591663744 00000100:00100000:3.0:1787579389.509483:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591663744 00000100:00100000:3.0:1787579389.509535:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 25 00000100:00100000:3.0:1787579389.509546:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec17c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+11:9703:x1874412591663744:12345-192.168.206.53@tcp:101:rm.0 00010000:00010000:3.0:1787579389.509567:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579389.509585:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b6ee9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cefb expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579389.509650:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fc400/0xb72beeaffa1b6ef0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579389.509687:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fc400/0xb72beeaffa1b6ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579389.509699:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fc400/0xb72beeaffa1b6ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579389.509766:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787579389.509769:0:5867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787579389.509808:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fc400/0xb72beeaffa1b6ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579389.509834:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b6ee9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cefb expref: 13 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579389.509855:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fc400/0xb72beeaffa1b6ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cefb expref: 12 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579389.509864:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:3.0:1787579389.509867:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787579389.509870:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce813fc400, rc 0) 00000100:00100000:3.0:1787579389.510149:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec17c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+12:9703:x1874412591663744:12345-192.168.206.53@tcp:101:rm.0 Request processed in 604us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579389.510156:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 25 00000100:00100000:2.0:1787579389.525593:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579389.525771:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591664000 00000100:00100000:1.0:1787579389.525781:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591664000 00000100:00100000:1.0:1787579389.525836:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 26 00000100:00100000:1.0:1787579389.525847:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec17c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+12:9703:x1874412591664000:12345-192.168.206.53@tcp:101:rm.0 00010000:00010000:1.0:1787579389.525863:0:9532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579389.525881:0:9532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8148b600/0xb72beeaffa1b6ef7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cf02 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579389.526066:0:9532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787579389.526201:0:9532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8148b600/0xb72beeaffa1b6ef7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf02 expref: 14 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.526215:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0cea147d700) 00010000:00010000:0.0:1787579389.526217:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787579389.526223:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8148b600/0xb72beeaffa1b6ef7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf02 expref: 14 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.526236:0:9532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8148b600, rc 0) 00000100:00100000:0.0:1787579389.526294:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec17c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+13:9703:x1874412591664000:12345-192.168.206.53@tcp:101:rm.0 Request processed in 449us (709us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1787579389.526301:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 26 00000100:00100000:1.0:1787579389.540266:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579389.540354:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591664128 00000100:00100000:0.0:1787579389.540363:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591664128 00000100:00100000:0.0:1787579389.540425:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 3 00000100:00100000:0.0:1787579389.540436:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+13:9703:x1874412591664128:12345-192.168.206.53@tcp:37:rm.0 00000100:00100000:2.0:1787579389.554030:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+13:9703:x1874412591664128:12345-192.168.206.53@tcp:37:rm.0 Request processed in 13586us (13763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579389.554043:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 3 00000100:00100000:2.0:1787579389.572122:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579389.572631:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591664384 00000100:00100000:1.0:1787579389.572654:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591664384 00000100:00100000:1.0:1787579389.572708:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 4 00000100:00100000:1.0:1787579389.572989:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce9c748450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+13:9703:x1874412591664384:12345-192.168.206.53@tcp:35:rm.0 00000100:00100000:1.0:1787579389.573240:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce9c748450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+14:9703:x1874412591664384:12345-192.168.206.53@tcp:35:rm.0 Request processed in 522us (1134us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787579389.573247:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 4 00000100:00100000:2.0:1787579389.576570:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579389.576815:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591664640 00000100:00100000:0.0:1787579389.576825:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591664640 00000100:00100000:0.0:1787579389.576892:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 27 00000100:00100000:0.0:1787579389.576903:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec17c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+14:9703:x1874412591664640:12345-192.168.206.53@tcp:101:rm.0 00010000:00010000:0.0:1787579389.576955:0:5866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579389.576977:0:5866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78a00/0xb72beeaffa1b6f05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cf09 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.577256:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f79200/0xb72beeaffa1b6f0c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.577269:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f79200/0xb72beeaffa1b6f0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.577280:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f79200/0xb72beeaffa1b6f0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579389.577290:0:5866:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787579389.577501:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78a00/0xb72beeaffa1b6f05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf09 expref: 17 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.577519:0:5866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f79200/0xb72beeaffa1b6f0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf09 expref: 16 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.577527:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:0.0:1787579389.577530:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787579389.577534:0:5866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb3f79200, rc 0) 00000100:00100000:0.0:1787579389.577589:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec17c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+16:9703:x1874412591664640:12345-192.168.206.53@tcp:101:rm.0 Request processed in 688us (1027us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787579389.578029:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 27 00000100:00100000:2.0:1787579389.585515:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579389.585585:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591664768 00000100:00100000:3.0:1787579389.585604:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591664768 00000100:00100000:3.0:1787579389.585655:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 28 00000100:00100000:3.0:1787579389.585664:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec17c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+16:9703:x1874412591664768:12345-192.168.206.53@tcp:41:rm.0 00000004:00000024:3.0:1787579389.585723:0:9530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1787579389.585793:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec17c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+16:9703:x1874412591664768:12345-192.168.206.53@tcp:41:rm.0 Request processed in 130us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579389.585801:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 28 00000100:00100000:2.0:1787579389.589790:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579389.589858:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591664896 00000100:00100000:0.0:1787579389.589867:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591664896 00000100:00100000:0.0:1787579389.589947:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 29 00000100:00100000:0.0:1787579389.589958:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec17c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+16:9703:x1874412591664896:12345-192.168.206.53@tcp:101:rm.0 00010000:00010000:0.0:1787579389.589975:0:9532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579389.589992:0:9532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78a00/0xb72beeaffa1b6f1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cf10 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.590058:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78200/0xb72beeaffa1b6f21 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.590072:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78200/0xb72beeaffa1b6f21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.590082:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78200/0xb72beeaffa1b6f21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.590096:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78e00/0xb72beeaffa1b6f28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x18cce540 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.590103:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78e00/0xb72beeaffa1b6f28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.590110:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78e00/0xb72beeaffa1b6f28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.590214:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78000/0xb72beeaffa1b6f2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.590238:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78000/0xb72beeaffa1b6f2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.590245:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78000/0xb72beeaffa1b6f2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579389.590270:0:9532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787579389.590274:0:9532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787579389.590290:0:9532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78000/0xb72beeaffa1b6f2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.590301:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78000/0xb72beeaffa1b6f2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.590308:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78200/0xb72beeaffa1b6f21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.590313:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78200/0xb72beeaffa1b6f21 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.590320:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78200/0xb72beeaffa1b6f21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.590325:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb3f78200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579389.590329:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78200/0xb72beeaffa1b6f21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.590336:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78200/0xb72beeaffa1b6f21 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.590346:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:0.0:1787579389.590349:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579389.590360:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78200/0xb72beeaffa1b6f21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.590366:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78200/0xb72beeaffa1b6f21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.590389:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78e00/0xb72beeaffa1b6f28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.590395:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78e00/0xb72beeaffa1b6f28 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.590401:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78e00/0xb72beeaffa1b6f28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.590406:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb3f78e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579389.590410:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78e00/0xb72beeaffa1b6f28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.590416:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78e00/0xb72beeaffa1b6f28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.590423:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x18cce540 (ffffa0ce82cbb400) 00010000:00010000:0.0:1787579389.590426:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579389.590429:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78e00/0xb72beeaffa1b6f28 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.590435:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78e00/0xb72beeaffa1b6f28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.590462:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78a00/0xb72beeaffa1b6f1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf10 expref: 18 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.590488:0:9532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78000/0xb72beeaffa1b6f2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf10 expref: 17 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.590496:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0cea147d400) 00010000:00010000:0.0:1787579389.590499:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787579389.590501:0:9532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb3f78000, rc 0) 00000100:00100000:0.0:1787579389.590556:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec17c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+17:9703:x1874412591664896:12345-192.168.206.53@tcp:101:rm.0 Request processed in 600us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579389.590564:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 29 00000100:00100000:2.0:1787579389.594413:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579389.594478:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591665152 00000100:00100000:0.0:1787579389.594487:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591665152 00000100:00100000:0.0:1787579389.594539:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 30 00000100:00100000:0.0:1787579389.594550:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec17c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+17:9703:x1874412591665152:12345-192.168.206.53@tcp:36:rm.0 00010000:00010000:0.0:1787579389.594611:0:5866:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787579389.594635:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78000/0xb72beeaffa1b6f2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf10 expref: 17 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.594653:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b6edb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cef4 expref: 16 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.594665:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0cea147d400) 00010000:00010000:0.0:1787579389.594679:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fc400/0xb72beeaffa1b6ef0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cefb expref: 15 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.594687:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:0.0:1787579389.594702:0:5866:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787579389.594730:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78600/0xb72beeaffa1b6f36 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.594743:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78600/0xb72beeaffa1b6f36 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.594752:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78600/0xb72beeaffa1b6f36 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.594782:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b6f3d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.594790:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b6f3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.594797:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b6f3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.594913:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b6f44 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.594922:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b6f44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.594963:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b6f44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787579389.595616:0:5866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787579389.595625:0:5866:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 325786698289ns, next at 326786696467ns, rc = 0 00010000:00010000:0.0:1787579389.595677:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b6f4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.595696:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b6f4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.595704:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b6f4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.595712:0:5866:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b6f4b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.595719:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b6f4b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.595725:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b6f4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.595739:0:5866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787579389.595755:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b6f44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.595762:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b6f44 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.595769:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b6f44 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.595775:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9600 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579389.595780:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b6f44 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.595787:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b6f44 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.595805:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0ce82cbbd00) 00010000:00010000:0.0:1787579389.595808:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787579389.595811:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b6f44 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.595817:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b6f44 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.595831:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78600/0xb72beeaffa1b6f36 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.595837:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78600/0xb72beeaffa1b6f36 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.595843:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78600/0xb72beeaffa1b6f36 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.595848:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb3f78600 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579389.595851:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78600/0xb72beeaffa1b6f36 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.595856:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78600/0xb72beeaffa1b6f36 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.595863:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:0.0:1787579389.595865:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579389.595868:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78600/0xb72beeaffa1b6f36 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.595875:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78600/0xb72beeaffa1b6f36 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787579389.595895:0:5866:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dade99a2 reply state 00000000d3fd15e5 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b6f3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579389.595903:0:5866:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787579389.596000:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec17c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+16:9703:x1874412591665152:12345-192.168.206.53@tcp:36:rm.0 Request processed in 1450us (1592us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787579389.596008:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 30 00010000:00010000:1.0:1787579389.596368:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787579389.596374:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b6f4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579389.596381:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9000 already unused, calling callback (ffffffffc1654230) 00010000:00010000:1.0:1787579389.596385:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b6f4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579389.596391:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b6f4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579389.596400:0:5854:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0ce82cbbd00) 00010000:00010000:1.0:1787579389.596403:0:5854:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787579389.596406:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b6f4b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579389.596411:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b6f4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579389.596424:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579389.596426:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579389.596428:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579389.600903:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00010000:00010000:0.0:1787579389.601080:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b6f3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.601092:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b6f3d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.601099:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b6f3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.601105:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8400 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579389.601110:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b6f3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.601130:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b6f3d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.601145:0:3305:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x18cce540 (ffffa0ce82cbb800) 00010000:00010000:0.0:1787579389.601148:0:3305:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579389.601153:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b6f3d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.601159:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b6f3d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579389.601964:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591665408 00000100:00100000:3.0:1787579389.601975:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591665408 00000100:00100000:3.0:1787579389.602022:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:3.0:1787579389.602031:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec17c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+15:9703:x1874412591665408:12345-192.168.206.53@tcp:35:rm.0 00000100:00100000:3.0:1787579389.602279:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec17c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+16:9703:x1874412591665408:12345-192.168.206.53@tcp:35:rm.0 Request processed in 247us (1382us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787579389.602287:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:2.0:1787579389.616785:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579389.616897:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591665664 00000100:00100000:0.0:1787579389.616905:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591665664 00000100:00100000:0.0:1787579389.616982:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 31 00000100:00100000:0.0:1787579389.616993:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec17c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+16:9703:x1874412591665664:12345-192.168.206.53@tcp:36:rm.0 00010000:00010000:0.0:1787579389.617060:0:5868:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787579389.617090:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f79200/0xb72beeaffa1b6f0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf09 expref: 16 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.617110:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb3f78400/0xb72beeaffa1b6eaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cee6 expref: 15 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.617130:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:0.0:1787579389.617146:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b6e6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ced8 expref: 14 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.617155:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0cea147d700) 00010000:00010000:0.0:1787579389.617162:0:5868:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787579389.617184:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b6f52 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.617197:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b6f52 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.617205:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b6f52 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.617218:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b6f59 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.617238:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b6f59 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.617246:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b6f59 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.617540:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b6f60 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.617550:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b6f60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.617557:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b6f60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579389.618194:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787579389.618209:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b6f60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.618217:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b6f60 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.618224:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b6f60 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.618229:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579389.618234:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b6f60 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.618241:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b6f60 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.618261:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0ce82cbb000) 00010000:00010000:0.0:1787579389.618264:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787579389.618268:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b6f60 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.618274:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b6f60 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.618290:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b6f52 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.618296:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b6f52 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.618301:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b6f52 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.618305:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8400 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579389.618308:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b6f52 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.618313:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b6f52 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.618319:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce82cbb800) 00010000:00010000:0.0:1787579389.618322:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579389.618324:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b6f52 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579389.618329:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b6f52 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787579389.618349:0:5868:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b88d3214 reply state 00000000f0fefb61 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b6f59 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579389.618357:0:5868:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787579389.618426:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec17c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+15:9703:x1874412591665664:12345-192.168.206.53@tcp:36:rm.0 Request processed in 1433us (1648us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787579389.618435:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 31 00000100:00100000:2.0:1787579389.623604:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579389.623638:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00010000:00010000:1.0:1787579389.623752:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b6f59 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579389.623782:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b6f59 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579389.623789:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b6f59 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579389.623796:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9600 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579389.623800:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b6f59 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579389.623807:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b6f59 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579389.623822:0:3306:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa0ce82cbb400) 00010000:00010000:1.0:1787579389.623825:0:3306:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579389.623829:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b6f59 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579389.623835:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b6f59 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579389.626016:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591665920 00000100:00100000:3.0:1787579389.626030:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591665920 00000100:00100000:3.0:1787579389.626120:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 90 00000100:00100000:3.0:1787579389.626200:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec17c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2362:x1874412591665920:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1787579389.626384:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec17c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2362:x1874412591665920:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 254us (2744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579389.626392:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 90 00000100:00080000:1.0:1787579389.626954:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579389.627173:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591665792 00000100:00100000:0.0:1787579389.627179:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591665792 00000100:00100000:0.0:1787579389.627211:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 245 00000100:00100000:0.0:1787579389.627218:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+13:2362:x1874412591665792:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579389.627259:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+13:2362:x1874412591665792:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 42us (3665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579389.627266:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 245 00000100:00100000:1.0:1787579389.920087:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787579389.920634:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba810700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616861312:0@lo:400:kworker.0 00000100:00100000:3.0:1787579389.920711:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579389.920766:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787579389.920772:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba810a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616861440:0@lo:400:kworker.0 00000100:00100000:3.0:1787579389.920820:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579389.920876:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616861568:0@lo:400:kworker.0 00000100:00100000:3.0:1787579389.920908:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579389.922573:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787579389.922601:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec17c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616861184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787579389.922625:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616861056:0@lo:400:kworker.0 00000100:00100000:3.0:1787579389.922700:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579389.922742:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579389.922786:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616861056 00000100:00100000:1.0:1787579389.922793:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616861056 00000100:00100000:1.0:1787579389.922832:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787579389.922840:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3322:x1874412616861056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579389.922893:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3322:x1874412616861056:12345-0@lo:400:kworker.0 Request processed in 54us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579389.922899:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787579389.922955:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616861056:0@lo:400:kworker.0 00000100:00100000:1.0:1787579389.922997:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616861312 00000100:00100000:1.0:1787579389.923001:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616861312 00000100:00100000:1.0:1787579389.923023:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616861440 00000100:00100000:1.0:1787579389.923026:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616861440 00000100:00100000:1.0:1787579389.923051:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787579389.923058:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616861312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579389.923095:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616861312:12345-0@lo:400:kworker.0 Request processed in 37us (2384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579389.923101:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787579389.923125:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787579389.923131:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616861568 00000100:00100000:1.0:1787579389.923133:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616861440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579389.923139:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616861568 00000100:00100000:1.0:1787579389.923171:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616861440:12345-0@lo:400:kworker.0 Request processed in 39us (2349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579389.923180:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787579389.923181:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787579389.923194:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616861568:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787579389.923207:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787579389.923213:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579389.923242:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616861184 00000100:00100000:3.0:1787579389.923244:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616861568:12345-0@lo:400:kworker.0 Request processed in 52us (2333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579389.923247:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616861184 00000100:00100000:3.0:1787579389.923255:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787579389.923288:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787579389.923298:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616861184:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787579389.923299:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba810a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616861440:0@lo:400:kworker.0 00000100:00100000:3.0:1787579389.923316:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba810700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616861312:0@lo:400:kworker.0 00002000:00000024:1.0:1787579389.923316:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:3.0:1787579389.923351:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceba813480 x1874412616861568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579389.923355:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616861184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579389.923363:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616861568:0@lo:400:kworker.0 00000100:00100000:1.0:1787579389.923376:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1787579389.923387:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec17c7b80 x1874412616861184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787579389.923399:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787579389.923402:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec17c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616861184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787579389.934486:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba811180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3322:1874412616861696:0@lo:400:kworker.0 00000100:00100000:1.0:1787579389.934626:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579389.934961:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616861696 00000100:00100000:2.0:1787579389.934969:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616861696 00000100:00100000:2.0:1787579389.935039:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787579389.935049:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1874412616861696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579389.935129:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1874412616861696:12345-0@lo:400:kworker.0 Request processed in 82us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579389.935137:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787579389.935317:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba811180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3322:1874412616861696:0@lo:400:kworker.0 00000100:00080000:1.0:1787579389.935910:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787579390.369896:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579390.450231:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787579390.450253:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec17c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616861824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787579390.450320:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579390.458580:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616861824 00000100:00100000:2.0:1787579390.458594:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616861824 00000100:00100000:2.0:1787579390.458663:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787579390.458672:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616861824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787579390.458709:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579390.458782:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616861824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (8462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579390.458788:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1787579390.464300:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0cec17c7b80 x1874412616861824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579390.464325:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec17c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616861824:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787579391.392079:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579392.416608:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579393.453023:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787579393.738846:0:11645:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1787579394.464129:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787579394.605798:0:5888:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1787579394.605813:0:5888:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787579394.606271:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616861952:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787579394.606334:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579394.606458:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616861952 00000100:00100000:2.0:1787579394.606465:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616861952 00000100:00100000:2.0:1787579394.606518:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787579394.606527:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616861952:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787579394.606552:0:6711:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1787579394.606583:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8c4bfc, atime: 0x6a8c4bfc, ctime: 0x6a8c4bfc, blocks: 0x1 00010000:00010000:2.0:1787579394.606590:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000758c461/0xb72beeaffa1b6f67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579394.606605:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=330s v=(0 0) 00010000:00010000:2.0:1787579394.606609:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579394.606615:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000758c461/0xb72beeaffa1b6f67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579394.606630:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000758c461/0xb72beeaffa1b6f67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579394.606640:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000758c461/0xb72beeaffa1b6f67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579394.606647:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000758c461/0xb72beeaffa1b6f67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579394.606669:0:6711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787579394.607336:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3320:x1874412616861952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 808us (999us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787579394.607344:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1787579394.607615:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787579394.607631:0:8476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787579394.607638:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000758c461/0xb72beeaffa1b6f67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.607648:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318200 already unused, calling callback (ffffffffc1654230) 00010000:00010000:3.0:1787579394.607652:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000758c461/0xb72beeaffa1b6f67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.607660:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000758c461/0xb72beeaffa1b6f67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.607678:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000758c461/0xb72beeaffa1b6f67 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.607685:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000758c461/0xb72beeaffa1b6f67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.607704:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579394.607707:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579394.607708:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787579394.607739:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0ceba831180/2, rc 0, transno 4294967300 00000100:00100000:3.0:1787579394.607746:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616861952:0@lo:6:osp-syn-1-0.0 00000020:00000080:3.0:1787579394.663586:0:11693:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe0d38b7b0 20000000:00000080:3.0:1787579394.663603:0:11693:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0ceb3d45c00 uarg=0000000000000000 20000000:01000000:3.0:1787579394.663638:0:11693:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787579394.663644:0:11693:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787579394.663648:0:11693:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1787579394.667758:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1787579394.668494:0:11693:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1787579394.675785:0:11693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1787579394.675841:0:11693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1787579394.675920:0:11693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1787579394.676603:0:11693:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787579394.676624:0:11693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6f6e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.676641:0:11693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ce8152e200/0xb72beeaffa1b6e10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6e09 expref: 18 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.676650:0:11693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ceb3f78c00/0xb72beeaffa1b6e17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cec3 expref: 12 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.676657:0:11693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ce8152ea00/0xb72beeaffa1b6e25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6e1e expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.676663:0:11693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ce8152e600/0xb72beeaffa1b6e33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6e2c expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.676671:0:11693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ceb3f79400/0xb72beeaffa1b6e3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ceca expref: 12 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.676679:0:11693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6f6e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.676717:0:11693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ceb3f79400/0xb72beeaffa1b6e3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ceca expref: 12 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.676731:0:11693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0ceb3f79400/0xb72beeaffa1b6e3a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ceca expref: 12 pid: 5860 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579394.676760:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4460000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11693:1874412616862080:192.168.206.53@tcp:104: 00010000:00010000:3.0:1787579394.676876:0:11693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ce8152e600/0xb72beeaffa1b6e33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b6e2c expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.676885:0:11693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0ce8152e600/0xb72beeaffa1b6e33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b6e2c expref: 18 pid: 5861 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579394.676894:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4462a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11693:1874412616862208:0@lo:104: 00000100:00100000:3.0:1787579394.676958:0:11693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787579394.676998:0:11693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ce8152ea00/0xb72beeaffa1b6e25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b6e1e expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.677007:0:11693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0ce8152ea00/0xb72beeaffa1b6e25 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b6e1e expref: 18 pid: 5860 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579394.677015:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba314a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11693:1874412616862336:0@lo:104: 00000100:00100000:3.0:1787579394.677040:0:11693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579394.677073:0:5848:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787579394.677095:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616862208 00000100:00100000:3.0:1787579394.677102:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616862208 00000100:00100000:3.0:1787579394.677149:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616862336 00000100:00100000:3.0:1787579394.677153:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616862336 00000100:00100000:3.0:1787579394.677169:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787579394.677177:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba315500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+4:11693:x1874412616862208:12345-0@lo:104: 00010000:00010000:3.0:1787579394.677189:0:5848:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ceba319200/0xb72beeaffa1b6e2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6e33 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.677233:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787579394.677245:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba315500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+4:11693:x1874412616862208:12345-0@lo:104: Request processed in 68us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579394.677253:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787579394.677269:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787579394.677274:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4067050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+3:11693:x1874412616862336:12345-0@lo:104: 00010000:00010000:3.0:1787579394.677281:0:5848:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f000/0xb72beeaffa1b6e1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6e25 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.677314:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787579394.677320:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4067050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+3:11693:x1874412616862336:12345-0@lo:104: Request processed in 46us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579394.677325:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1787579394.677359:0:5853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787579394.677364:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ceba319200/0xb72beeaffa1b6e2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6e33 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.677371:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba319200 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:3.0:1787579394.677374:0:5853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ceba319200/0xb72beeaffa1b6e2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b6e33 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.677382:0:5853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ceba319200/0xb72beeaffa1b6e2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b6e33 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787579394.677399:0:5853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ceba319200/0xb72beeaffa1b6e2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b6e33 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579394.677405:0:5853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787579394.677432:0:5853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ceba319200/0xb72beeaffa1b6e2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6e33 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.677449:0:5853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787579394.677468:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ceba319200/0xb72beeaffa1b6e2c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6e33 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.677475:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ceba319200/0xb72beeaffa1b6e2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6e33 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.677488:0:5853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787579394.677491:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f000/0xb72beeaffa1b6e1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6e25 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.677497:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8152f000 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:3.0:1787579394.677500:0:5853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f000/0xb72beeaffa1b6e1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b6e25 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.677506:0:5853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f000/0xb72beeaffa1b6e1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b6e25 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787579394.677513:0:5853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f000/0xb72beeaffa1b6e1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b6e25 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579394.677518:0:5853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787579394.677531:0:5853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f000/0xb72beeaffa1b6e1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6e25 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.677537:0:5853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787579394.677856:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f000/0xb72beeaffa1b6e1e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6e25 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.677864:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce8152f000/0xb72beeaffa1b6e1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6e25 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.677879:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579394.677881:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579394.677882:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579394.677889:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579394.677906:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616862464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787579394.677970:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579394.677997:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787579394.678002:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616862592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787579394.678021:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579394.678045:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616862464 00000100:00100000:3.0:1787579394.678049:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616862464 00010000:00010000:3.0:1787579394.678065:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ce8152e600/0xb72beeaffa1b6e33 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6e2c expref: 19 pid: 5861 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579394.678081:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616862592 00000100:00100000:3.0:1787579394.678095:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616862592 00010000:00010000:3.0:1787579394.678105:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ce8152ea00/0xb72beeaffa1b6e25 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6e1e expref: 20 pid: 5860 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579394.678121:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787579394.678127:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba315c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+20:3321:x1874412616862464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787579394.678224:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579394.678231:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ce8152e600/0xb72beeaffa1b6e33 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6e2c expref: 20 pid: 5861 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.678240:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ce8152e600/0xb72beeaffa1b6e33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b6e2c expref: 20 pid: 5861 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.678263:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579394.678289:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba315c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+20:3321:x1874412616862464:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579394.678296:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787579394.678308:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787579394.678314:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba317b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3321:x1874412616862592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787579394.678321:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579394.678325:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ce8152ea00/0xb72beeaffa1b6e25 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6e1e expref: 19 pid: 5860 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.678333:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ce8152ea00/0xb72beeaffa1b6e25 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b6e1e expref: 19 pid: 5860 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.678342:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579394.678358:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba317b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3321:x1874412616862592:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579394.678364:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787579394.678504:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616862592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787579394.678516:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616862464:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787579394.678558:0:11693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ceb3f78c00/0xb72beeaffa1b6e17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cec3 expref: 12 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.678568:0:11693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0ceb3f78c00/0xb72beeaffa1b6e17 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cec3 expref: 12 pid: 5859 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579394.678578:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba315500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11693:1874412616862720:192.168.206.53@tcp:104: 00010000:00010000:3.0:1787579394.678721:0:11693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ce8152e200/0xb72beeaffa1b6e10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b6e09 expref: 18 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.678730:0:11693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0ce8152e200/0xb72beeaffa1b6e10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b6e09 expref: 18 pid: 5859 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579394.678738:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba314700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11693:1874412616862848:0@lo:104: 00000100:00100000:3.0:1787579394.678758:0:11693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579394.678778:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cebf2e3300 going to sleep for 11 seconds 00010000:00010000:3.0:1787579394.678788:0:11693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce8152e600/0xb72beeaffa1b6e33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b6e2c expref: 18 pid: 5861 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579394.678798:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4462a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11693:1874412616862208:0@lo:104: 00010000:00010000:3.0:1787579394.678805:0:11693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce8152ea00/0xb72beeaffa1b6e25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b6e1e expref: 17 pid: 5860 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579394.678812:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba314a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11693:1874412616862336:0@lo:104: 00000100:00100000:2.0:1787579394.679079:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616862848 00000100:00100000:2.0:1787579394.679093:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616862848 00000100:00100000:2.0:1787579394.679122:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787579394.679128:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba316d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+3:11693:x1874412616862848:12345-0@lo:104: 00010000:00010000:2.0:1787579394.679149:0:5848:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b6e09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6e10 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579394.679185:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787579394.679189:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba316d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+3:11693:x1874412616862848:12345-0@lo:104: Request processed in 62us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579394.679195:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1787579394.679530:0:8475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787579394.679536:0:8475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b6e09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b6e10 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.679543:0:8475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba319000 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:3.0:1787579394.679547:0:8475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b6e09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b6e10 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.679554:0:8475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b6e09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b6e10 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787579394.679561:0:8475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b6e09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b6e10 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579394.679574:0:8475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787579394.679598:0:8475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b6e09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6e10 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.679605:0:8475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787579394.679623:0:8475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b6e09 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6e10 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.679631:0:8475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b6e09 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b6e10 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.679646:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579394.679647:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579394.679649:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579394.679671:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616862976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787579394.679697:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579394.679729:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616862976 00000100:00100000:3.0:1787579394.679733:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616862976 00010000:00010000:3.0:1787579394.679747:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ce8152e200/0xb72beeaffa1b6e10 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6e09 expref: 17 pid: 5859 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579394.679763:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787579394.679768:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:3319:x1874412616862976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787579394.679775:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579394.679780:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ce8152e200/0xb72beeaffa1b6e10 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b6e09 expref: 17 pid: 5859 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.679788:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ce8152e200/0xb72beeaffa1b6e10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b6e09 expref: 17 pid: 5859 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.679806:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579394.679830:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:3319:x1874412616862976:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579394.679836:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787579394.679878:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616862976:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787579394.679906:0:11693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce8152e200/0xb72beeaffa1b6e10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b6e09 expref: 16 pid: 5859 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579394.679915:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba314700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11693:1874412616862848:0@lo:104: 00000100:00100000:0.0:1787579394.684778:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4460000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11693:1874412616862080:192.168.206.53@tcp:104: 00000100:00100000:2.0:1787579394.685108:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579394.685467:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591666048 00000100:00100000:1.0:1787579394.685475:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591666048 00010000:00010000:1.0:1787579394.685509:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ceb3f79400/0xb72beeaffa1b6e3a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ceca expref: 13 pid: 5860 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579394.685548:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 33 00000100:00100000:1.0:1787579394.685557:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce90ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:803d6039-c137-4d52-85de-c5895e5f2411+13:2360:x1874412591666048:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787579394.685571:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787579394.685577:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ceb3f79400/0xb72beeaffa1b6e3a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ceca expref: 13 pid: 5860 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579394.685589:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ceb3f79400/0xb72beeaffa1b6e3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ceca expref: 13 pid: 5860 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579394.685607:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ceb3f79400/0xb72beeaffa1b6e3a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ceca expref: 13 pid: 5860 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579394.685619:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787579394.685802:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce90ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:803d6039-c137-4d52-85de-c5895e5f2411+12:2360:x1874412591666048:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 245us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579394.685810:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 33 00000100:00100000:2.0:1787579394.692473:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579394.692498:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba315500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11693:1874412616862720:192.168.206.53@tcp:104: 00010000:00010000:0.0:1787579394.692537:0:11693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6f6e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579394.692551:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591666176 00000100:00100000:3.0:1787579394.692559:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591666176 00010000:00010000:3.0:1787579394.692591:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ceb3f78c00/0xb72beeaffa1b6e17 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cec3 expref: 12 pid: 5859 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579394.692630:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 34 00000100:00100000:3.0:1787579394.692639:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba833480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:803d6039-c137-4d52-85de-c5895e5f2411+12:2359:x1874412591666176:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787579394.692652:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579394.692658:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ceb3f78c00/0xb72beeaffa1b6e17 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cec3 expref: 12 pid: 5859 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.692669:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ceb3f78c00/0xb72beeaffa1b6e17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cec3 expref: 12 pid: 5859 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.692686:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ceb3f78c00/0xb72beeaffa1b6e17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cec3 expref: 12 pid: 5859 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.692701:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6f6e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.692722:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6f6e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.692735:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6f6e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.692743:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6f6e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.692751:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6f6e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.692757:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6f6e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.692763:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce813fde00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:3.0:1787579394.692767:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6f6e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.692775:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6f6e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.692795:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6f6e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579394.692804:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787579394.692818:0:11693:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6f6e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579394.692828:0:11693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6f6e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579394.692842:0:11693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce813fde00/0xb72beeaffa1b6f6e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579394.692866:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba833480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:803d6039-c137-4d52-85de-c5895e5f2411+11:2359:x1874412591666176:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 226us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579394.692884:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 34 00000100:00100000:2.0:1787579394.737408:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579394.737445:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591666304 00000100:00100000:2.0:1787579394.737454:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591666304 00000100:00100000:2.0:1787579394.737512:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 94 00000100:00100000:2.0:1787579394.737523:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+5:2362:x1874412591666304:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1787579394.737590:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+5:2362:x1874412591666304:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 69us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579394.737598:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 94 00000100:00080000:3.0:1787579394.737787:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579394.744222:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579394.744261:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579394.744307:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591666432 00000100:00100000:3.0:1787579394.744317:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591666432 00000100:00100000:3.0:1787579394.744387:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 43 00000100:00100000:3.0:1787579394.744397:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+5:2361:x1874412591666432:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1787579394.744461:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+5:2361:x1874412591666432:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 67us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579394.744469:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 43 00000100:00080000:1.0:1787579394.744602:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787579394.744708:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591666560 00000100:00100000:2.0:1787579394.744713:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591666560 00000100:00100000:2.0:1787579394.744759:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 95 00000100:00100000:2.0:1787579394.744766:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb468bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2361:x1874412591666560:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1787579394.744805:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb468bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2361:x1874412591666560:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 39us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579394.744812:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 95 00000100:00080000:1.0:1787579394.744877:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579395.040333:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787579395.040354:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba811180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616863104:0@lo:400:kworker.0 00000100:00100000:1.0:1787579395.040420:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579395.040524:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616863104 00000100:00100000:2.0:1787579395.040532:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616863104 00000100:00100000:2.0:1787579395.040583:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787579395.040592:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb1d50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:3319:x1874412616863104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579395.040640:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb1d50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:3319:x1874412616863104:12345-0@lo:400:kworker.0 Request processed in 49us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579395.040646:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787579395.040740:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba811180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616863104:0@lo:400:kworker.0 00000100:00100000:1.0:1787579395.040881:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787579395.040890:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3322:1874412616863232:0@lo:400:kworker.0 00000100:00100000:1.0:1787579395.040919:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579395.041019:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3322:1874412616863360:0@lo:400:kworker.0 00000100:00100000:1.0:1787579395.041043:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579395.041063:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787579395.041069:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3322:1874412616863744:0@lo:400:kworker.0 00000100:00100000:1.0:1787579395.041104:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579395.041131:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616863232 00000100:00100000:1.0:1787579395.041135:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616863232 00000100:00100000:1.0:1787579395.041162:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616863360 00000100:00100000:1.0:1787579395.041165:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616863360 00000100:00100000:1.0:1787579395.041190:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616863744 00000100:00100000:1.0:1787579395.041193:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616863744 00000100:00100000:1.0:1787579395.041210:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787579395.041216:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1874412616863232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579395.041360:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1874412616863232:12345-0@lo:400:kworker.0 Request processed in 142us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579395.041379:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787579395.041395:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787579395.041402:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1874412616863360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579395.041432:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1874412616863360:12345-0@lo:400:kworker.0 Request processed in 31us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579395.041438:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787579395.041450:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787579395.041456:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1874412616863744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579395.041483:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1874412616863744:12345-0@lo:400:kworker.0 Request processed in 27us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579395.041488:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1787579395.041509:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579395.041528:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3322:1874412616863744:0@lo:400:kworker.0 00000100:00100000:1.0:1787579395.041538:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3322:1874412616863360:0@lo:400:kworker.0 00000100:00100000:1.0:1787579395.041546:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3322:1874412616863232:0@lo:400:kworker.0 00000100:00100000:1.0:1787579395.041571:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616863488:0@lo:400:kworker.0 00000100:00100000:1.0:1787579395.041597:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579395.041619:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787579395.041625:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616863616:0@lo:400:kworker.0 00000100:00100000:1.0:1787579395.041645:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579395.041670:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616863488 00000100:00100000:1.0:1787579395.041674:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616863488 00000100:00100000:1.0:1787579395.041700:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616863616 00000100:00100000:1.0:1787579395.041703:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616863616 00000100:00100000:1.0:1787579395.041731:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787579395.041738:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616863488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579395.041773:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616863488:12345-0@lo:400:kworker.0 Request processed in 36us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579395.041779:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787579395.041790:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787579395.041796:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb468b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1874412616863616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579395.041824:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb468b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1874412616863616:12345-0@lo:400:kworker.0 Request processed in 28us (177us total) trans 0 rc 0/0 00000100:00080000:2.0:1787579395.042065:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787579395.043415:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616863616:0@lo:400:kworker.0 00010000:00080000:0.0:1787579395.043431:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceb468a680 x1874412616863488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579395.043441:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616863488:0@lo:400:kworker.0 00000100:00100000:1.0:1787579395.043527:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787579395.045399:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616863872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787579395.045465:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579395.045620:0:7952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616863872 00000100:00100000:2.0:1787579395.045628:0:7952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616863872 00000100:00100000:2.0:1787579395.045681:0:7952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787579395.045690:0:7952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb468a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3322:x1874412616863872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787579395.045721:0:7952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579395.045771:0:7952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb468a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3322:x1874412616863872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579395.045778:0:7952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787579395.045860:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616863872:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787579395.489828:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579395.552239:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787579395.552260:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616864000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787579395.552323:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579395.552506:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616864000 00000100:00100000:1.0:1787579395.552514:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616864000 00000100:00100000:1.0:1787579395.552560:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787579395.552580:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616864000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787579395.552612:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787579395.552666:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616864000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579395.552673:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1787579395.552836:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceba831c00 x1874412616864000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579395.552854:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616864000:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1787579396.128041:0:5863:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787579396.128048:0:5863:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0ceb3138000 from 7 10000000:01000000:2.0:1787579396.128053:0:5863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787579396.128109:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba319800/0xb72beeaffa1b6f75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579396.128148:0:5863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ceba319800/0xb72beeaffa1b6f75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579396.128159:0:5863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ceba319800/0xb72beeaffa1b6f75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579396.128183:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba831500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616864128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787579396.128245:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579396.128322:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce97767540 going to sleep for 11 seconds 00000100:00100000:1.0:1787579396.129742:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616864128 00000100:00100000:1.0:1787579396.129753:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616864128 00000100:00100000:1.0:1787579396.129818:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787579396.129828:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb1d53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:5863:x1874412616864128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787579396.129843:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579396.129878:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce8148ac00/0xb72beeaffa1b6f7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6f75 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579396.129902:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce8148ac00/0xb72beeaffa1b6f7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6f75 expref: 17 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579396.129913:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce8148ac00/0xb72beeaffa1b6f7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6f75 expref: 17 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579396.129921:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8148ac00, rc 0) 00000100:00100000:1.0:1787579396.130014:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb1d53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616864128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (1768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579396.130021:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787579396.130226:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba831500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616864128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787579396.130243:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ceba319800/0xb72beeaffa1b6f75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6f7c expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579396.130252:0:5863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ceba319800/0xb72beeaffa1b6f75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6f7c expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579396.130323:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616864256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787579396.130355:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579396.130387:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cebf2e3900 going to sleep for 11 seconds 00000100:00100000:2.0:1787579396.131060:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616864256 00000100:00100000:2.0:1787579396.131067:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616864256 00000100:00100000:2.0:1787579396.131126:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787579396.131142:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb1d53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616864256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787579396.131417:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb1d53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616864256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579396.131424:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787579396.131753:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616864256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787579396.131803:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616864384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787579396.131857:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579396.131883:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cebf2e3900 going to sleep for 11 seconds 00000100:00100000:1.0:1787579396.132107:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616864384 00000100:00100000:1.0:1787579396.132112:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616864384 00000100:00100000:1.0:1787579396.132152:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787579396.132159:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce857d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616864384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787579396.132318:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce857d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616864384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579396.132325:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787579396.132660:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616864384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787579396.135340:0:11707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4460000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:11707:1874412616864512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787579396.135420:0:11707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579396.135517:0:11707:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cec1595540 going to sleep for 11 seconds 00000100:00100000:1.0:1787579396.150045:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579396.162957:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616864512 00000100:00100000:0.0:1787579396.162972:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616864512 00000100:00100000:0.0:1787579396.163042:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591666688 00000100:00100000:0.0:1787579396.163045:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591666688 00000100:00100000:0.0:1787579396.163064:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787579396.163075:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce857d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:11707:x1874412616864512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787579396.163365:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce857d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:11707:x1874412616864512:12345-0@lo:502:llog_process_th.0 Request processed in 292us (27944us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579396.163373:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787579396.163414:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 252 00000100:00100000:0.0:1787579396.163421:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+11:5603:x1874412591666688:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787579396.163429:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579396.163445:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceba3c9800/0xb72beeaffa1b6f83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cf17 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579396.163469:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceba3c9800/0xb72beeaffa1b6f83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf17 expref: 12 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579396.163493:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceba3c9800/0xb72beeaffa1b6f83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf17 expref: 12 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579396.163502:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c9800, rc 0) 00000100:00100000:0.0:1787579396.163540:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+12:5603:x1874412591666688:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 Request processed in 119us (13503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579396.163546:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 252 00000100:00100000:3.0:1787579396.163888:0:11707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4460000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:11707:1874412616864512:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787579396.163923:0:11707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787579396.163950:0:11707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579396.163952:0:11707:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787579396.163958:0:11707:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0ceb3138000 00000020:00000080:3.0:1787579396.163960:0:11707:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787579396.164038:0:11707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:11707:1874412616864640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787579396.164093:0:11707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579396.164120:0:11707:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cebf2e3900 going to sleep for 11 seconds 00000100:00100000:1.0:1787579396.167649:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616864640 00000100:00100000:1.0:1787579396.167660:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616864640 00000100:00100000:1.0:1787579396.167701:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787579396.167708:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84e09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:11707:x1874412616864640:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787579396.167975:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84e09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:11707:x1874412616864640:12345-0@lo:502:llog_process_th.0 Request processed in 266us (3881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579396.167982:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787579396.168069:0:11707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:11707:1874412616864640:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787579396.168107:0:11707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787579396.168114:0:11707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579396.168116:0:11707:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787579396.168119:0:11707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787579396.168235:0:5863:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787579396.168251:0:5863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787579396.168271:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba319800/0xb72beeaffa1b6f75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6f7c expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579396.168281:0:5863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ceba319800/0xb72beeaffa1b6f75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6f7c expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579396.168291:0:5863:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787579396.168293:0:5863:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0ce84eda800 from 7 10000000:01000000:1.0:1787579396.168295:0:5863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787579396.168326:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b600/0xb72beeaffa1b6f8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579396.168334:0:5863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b600/0xb72beeaffa1b6f8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579396.168343:0:5863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b600/0xb72beeaffa1b6f8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579396.168359:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4462a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616864768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787579396.168394:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579396.168419:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9746a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787579396.168429:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616864768 00000100:00100000:1.0:1787579396.168432:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616864768 00000100:00100000:1.0:1787579396.168449:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787579396.168455:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84e0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:5863:x1874412616864768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787579396.168462:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579396.168472:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce8148ba00/0xb72beeaffa1b6f91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6f8a expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579396.168488:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce8148ba00/0xb72beeaffa1b6f91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6f8a expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579396.168498:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce8148ba00/0xb72beeaffa1b6f91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6f8a expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579396.168506:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8148ba00, rc 0) 00000100:00100000:1.0:1787579396.168528:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84e0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616864768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579396.168533:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787579396.168557:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4462a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616864768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787579396.168567:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b600/0xb72beeaffa1b6f8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6f91 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579396.168576:0:5863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b600/0xb72beeaffa1b6f8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6f91 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579396.168609:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4462a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616864896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787579396.168635:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579396.168645:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9746a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787579396.168655:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616864896 00000100:00100000:1.0:1787579396.168657:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616864896 00000100:00100000:1.0:1787579396.168673:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787579396.168678:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616864896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787579396.168851:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616864896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579396.168857:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787579396.168880:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4462a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616864896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787579396.168900:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4462a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616865024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787579396.168949:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579396.168960:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9746a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787579396.168969:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616865024 00000100:00100000:1.0:1787579396.168972:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616865024 00000100:00100000:1.0:1787579396.168988:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787579396.168993:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce85749850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616865024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787579396.169094:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce85749850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616865024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579396.169100:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787579396.169130:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4462a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616865024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787579396.169257:0:11708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4462a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:11708:1874412616865152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787579396.169286:0:11708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579396.169301:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616865152 00000100:00100000:1.0:1787579396.169308:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616865152 00000100:00100000:1.0:1787579396.169325:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787579396.169330:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce85749050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:11708:x1874412616865152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787579396.169421:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce85749050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:11708:x1874412616865152:12345-0@lo:502:llog_process_th.0 Request processed in 90us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579396.169427:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787579396.169450:0:11708:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9746af00 going to sleep for 11 seconds 00000100:00100000:1.0:1787579396.169459:0:11708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4462a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:11708:1874412616865152:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787579396.169474:0:11708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787579396.169480:0:11708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579396.169482:0:11708:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787579396.169487:0:11708:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0ce84eda800 00000020:00000080:1.0:1787579396.169489:0:11708:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787579396.169538:0:11708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4462a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:11708:1874412616865280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787579396.169565:0:11708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579396.169580:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616865280 00000100:00100000:1.0:1787579396.169583:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616865280 00000100:00100000:1.0:1787579396.169599:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787579396.169603:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8574b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:11708:x1874412616865280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787579396.176591:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8574b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:11708:x1874412616865280:12345-0@lo:502:llog_process_th.0 Request processed in 6978us (7016us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579396.176605:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787579396.176684:0:11708:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9746af00 going to sleep for 11 seconds 00000100:00100000:1.0:1787579396.176708:0:11708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4462a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:11708:1874412616865280:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787579396.176737:0:11708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787579396.176745:0:11708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579396.176752:0:11708:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787579396.176757:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787579396.176833:0:5863:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787579396.177497:0:5863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787579396.177507:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b600/0xb72beeaffa1b6f8a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6f91 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579396.177516:0:5863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b600/0xb72beeaffa1b6f8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6f91 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579396.177526:0:5863:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787579396.177529:0:5863:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0ce90be4800 from 7 10000000:01000000:1.0:1787579396.177531:0:5863:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787579396.177561:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6f98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579396.177569:0:5863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6f98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579396.177578:0:5863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6f98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579396.177597:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4462a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616865408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787579396.177635:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579396.177661:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce867e8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787579396.177676:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616865408 00000100:00100000:1.0:1787579396.177681:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616865408 00000100:00100000:1.0:1787579396.177711:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787579396.177719:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce85748c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:5863:x1874412616865408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787579396.177729:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579396.177744:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce8148bc00/0xb72beeaffa1b6f9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b6f98 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579396.177764:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce8148bc00/0xb72beeaffa1b6f9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b6f98 expref: 19 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579396.177774:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce8148bc00/0xb72beeaffa1b6f9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b6f98 expref: 19 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579396.183460:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8148bc00, rc 0) 00000100:00100000:1.0:1787579396.183544:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce85748c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:5863:x1874412616865408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 5822us (5905us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579396.183553:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787579396.183602:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4462a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616865408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787579396.183624:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6f98 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6f9f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579396.183635:0:5863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6f98 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6f9f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579396.183701:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4462a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616865536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787579396.183733:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579396.183759:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce867e8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787579396.183794:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616865536 00000100:00100000:1.0:1787579396.183800:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616865536 00000100:00100000:1.0:1787579396.183840:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787579396.184015:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce85749450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:5863:x1874412616865536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787579396.184491:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce85749450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:5863:x1874412616865536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 641us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579396.184506:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787579396.184534:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4462a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616865536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787579396.184563:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4462a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616865664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787579396.184603:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579396.184613:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce867e8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787579396.184630:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616865664 00000100:00100000:1.0:1787579396.184633:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616865664 00000100:00100000:1.0:1787579396.184652:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787579396.184658:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8574bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:5863:x1874412616865664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787579396.185033:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579396.185094:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4462a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:5863:1874412616865664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787579396.185286:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba811f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:11710:1874412616865792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787579396.185331:0:11710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579396.185347:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceba65d540 going to sleep for 11 seconds 00000100:00100000:2.0:1787579396.185610:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591666816 00000100:00100000:2.0:1787579396.185616:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591666816 00000100:00100000:2.0:1787579396.185636:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616865792 00000100:00100000:2.0:1787579396.185638:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616865792 00000100:00100000:2.0:1787579396.185650:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 262 00000100:00100000:2.0:1787579396.185657:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91ddac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+12:5603:x1874412591666816:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787579396.185854:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91ddac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+12:5603:x1874412591666816:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 Request processed in 189us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579396.185862:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 262 00000100:00100000:2.0:1787579396.185883:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787579396.185894:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+20:11710:x1874412616865792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787579396.186038:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+20:11710:x1874412616865792:12345-0@lo:502:llog_process_th.0 Request processed in 144us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579396.186044:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787579396.188247:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8574bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:5863:x1874412616865664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3581us (3635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579396.188503:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787579396.189145:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba811f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:11710:1874412616865792:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787579396.189184:0:11710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787579396.189192:0:11710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579396.189194:0:11710:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787579396.189201:0:11710:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0ce90be4800 00000020:00000080:0.0:1787579396.189204:0:11710:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787579396.189704:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba811f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:11710:1874412616865920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787579396.189758:0:11710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579396.189791:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceba65d540 going to sleep for 11 seconds 00000100:00100000:2.0:1787579396.189993:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616865920 00000100:00100000:2.0:1787579396.190000:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616865920 00000100:00100000:2.0:1787579396.190038:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787579396.190047:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:11710:x1874412616865920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787579396.190533:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:11710:x1874412616865920:12345-0@lo:502:llog_process_th.0 Request processed in 487us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579396.190541:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787579396.190720:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba811f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:11710:1874412616865920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787579396.190742:0:11710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787579396.190748:0:11710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579396.190756:0:11710:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787579396.190762:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787579396.191235:0:5863:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787579396.191269:0:5863:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787579396.191278:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6f98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6f9f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579396.191289:0:5863:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6f98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6f9f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579396.195622:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579396.196678:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591666944 00000100:00100000:1.0:1787579396.196688:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591666944 00000100:00100000:1.0:1787579396.196741:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 265 00000100:00100000:1.0:1787579396.196750:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce85748450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+12:5603:x1874412591666944:12345-192.168.206.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787579396.200698:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce85748450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+12:5603:x1874412591666944:12345-192.168.206.53@tcp:503:ll_cfg_requeue.0 Request processed in 3938us (5073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579396.200712:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 265 00000100:00100000:0.0:1787579396.206306:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579396.206523:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591667072 00000100:00100000:1.0:1787579396.206533:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591667072 00000100:00100000:1.0:1787579396.206584:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 266 00000100:00100000:1.0:1787579396.206594:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+12:9973:x1874412591667072:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787579396.206885:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+12:9973:x1874412591667072:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 290us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579396.206893:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 266 00000040:00080000:2.0:1787579396.211622:0:11712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787579396.221130:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579396.221366:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591667200 00000100:00100000:3.0:1787579396.221376:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591667200 00000100:00100000:3.0:1787579396.221417:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 267 00000100:00100000:3.0:1787579396.221426:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+12:9973:x1874412591667200:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787579396.222106:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+12:9973:x1874412591667200:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 678us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579396.222116:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 267 00000100:00100000:0.0:1787579396.270290:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579396.271528:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591667328 00000100:00100000:3.0:1787579396.271539:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591667328 00000100:00100000:3.0:1787579396.271591:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 268 00000100:00100000:3.0:1787579396.271600:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91ddb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+12:5603:x1874412591667328:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787579396.271621:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579396.271636:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6fa6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cf1e expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579396.271660:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6fa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf1e expref: 13 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579396.271670:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6fa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf1e expref: 13 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579396.271679:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce813fc400, rc 0) 00000100:00100000:3.0:1787579396.271732:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91ddb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+13:5603:x1874412591667328:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 Request processed in 133us (1451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579396.271740:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 268 00000100:00100000:0.0:1787579396.274657:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579396.274701:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591667456 00000100:00100000:3.0:1787579396.274710:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591667456 00000100:00100000:3.0:1787579396.274756:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 269 00000100:00100000:3.0:1787579396.274766:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+13:5603:x1874412591667456:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787579396.275062:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+13:5603:x1874412591667456:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 Request processed in 297us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579396.275070:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 269 00000100:00100000:3.0:1787579396.279196:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579396.279280:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591667584 00000100:00100000:0.0:1787579396.279289:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591667584 00000100:00100000:0.0:1787579396.279344:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 270 00000100:00100000:0.0:1787579396.279363:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+13:5603:x1874412591667584:12345-192.168.206.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787579396.279566:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+13:5603:x1874412591667584:12345-192.168.206.53@tcp:503:ll_cfg_requeue.0 Request processed in 204us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579396.279574:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 270 00000100:00100000:0.0:1787579396.290237:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579396.290583:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591667712 00000100:00100000:3.0:1787579396.290594:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591667712 00000100:00100000:3.0:1787579396.290647:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 271 00000100:00100000:3.0:1787579396.290659:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+13:9976:x1874412591667712:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787579396.291639:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+13:9976:x1874412591667712:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 979us (1406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579396.291649:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 271 00000100:00100000:0.0:1787579396.300228:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579396.300314:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591667840 00000100:00100000:3.0:1787579396.300324:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591667840 00000100:00100000:3.0:1787579396.300380:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 272 00000100:00100000:3.0:1787579396.300389:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91ddb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+13:9976:x1874412591667840:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787579396.300624:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91ddb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+13:9976:x1874412591667840:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 235us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579396.300632:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 272 00010000:00010000:3.0:1787579396.512720:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787579397.216679:0:11712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787579397.536954:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579398.560166:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579399.584146:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787579399.739769:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:1.0:1787579399.858166:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579399.858205:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579399.858233:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579399.858259:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579399.858289:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591668096 00000100:00100000:1.0:1787579399.858298:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591668096 00000100:00100000:2.0:1787579399.858302:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591668224 00000100:00100000:2.0:1787579399.858308:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591668224 00000100:00100000:1.0:1787579399.858357:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591668352 00000100:00100000:1.0:1787579399.858361:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591668352 00000100:00100000:2.0:1787579399.858366:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 46 00000100:00100000:2.0:1787579399.858379:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4462a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+5:2361:x1874412591668224:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579399.858388:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 99 00000100:00100000:1.0:1787579399.858398:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+5:2361:x1874412591668096:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1787579399.858451:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4462a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+5:2361:x1874412591668224:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 75us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579399.858469:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591667968 00000100:00100000:0.0:1787579399.858475:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591667968 00000100:00100000:2.0:1787579399.858476:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 46 00000100:00100000:0.0:1787579399.858506:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 273 00000100:00100000:0.0:1787579399.858513:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+13:2361:x1874412591667968:12345-192.168.206.53@tcp:400:kworker.0 00000100:00080000:2.0:1787579399.858630:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787579399.858635:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579399.862270:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+5:2361:x1874412591668096:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 3863us (4025us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579399.862285:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 99 00000100:00100000:1.0:1787579399.862319:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 100 00000100:00100000:1.0:1787579399.862330:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec17c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2361:x1874412591668352:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579399.862375:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec17c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2361:x1874412591668352:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 48us (4114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579399.862381:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 100 00000100:00100000:0.0:1787579399.864833:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+13:2361:x1874412591667968:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 6312us (6667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579399.864846:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 273 00000100:00100000:0.0:1787579400.160787:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616866048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787579400.160849:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579400.160903:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787579400.160909:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1874412616866432:0@lo:400:kworker.0 00000100:00100000:0.0:1787579400.160971:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579400.161002:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616866048 00000100:00100000:0.0:1787579400.161009:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616866048 00000100:00100000:0.0:1787579400.161067:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787579400.161077:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616866048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787579400.161106:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579400.161144:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616866048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579400.161151:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787579400.161172:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616866432 00000100:00100000:0.0:1787579400.161175:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616866432 00000100:00100000:0.0:1787579400.161198:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787579400.161204:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874412616866432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579400.161230:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874412616866432:12345-0@lo:400:kworker.0 Request processed in 27us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579400.161236:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787579400.161269:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1874412616866432:0@lo:400:kworker.0 00000100:00100000:0.0:1787579400.161278:0:3320:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1787579400.161282:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0ceba831180, transno 4294967300 00000100:00100000:0.0:1787579400.161294:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616866048:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787579400.161590:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787579400.161594:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787579400.161613:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3322:1874412616866304:0@lo:400:kworker.0 00000100:00100000:0.0:1787579400.161638:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579400.161656:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787579400.161661:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616866176:0@lo:400:kworker.0 00000100:00100000:0.0:1787579400.161757:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579400.161788:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616866304 00000100:00100000:0.0:1787579400.161792:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616866304 00000100:00100000:0.0:1787579400.161813:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787579400.161818:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1874412616866304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579400.161850:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1874412616866304:12345-0@lo:400:kworker.0 Request processed in 31us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579400.161855:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787579400.161878:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3322:1874412616866304:0@lo:400:kworker.0 00000100:00100000:1.0:1787579400.161966:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616866176 00000100:00100000:1.0:1787579400.161970:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616866176 00000100:00100000:1.0:1787579400.161999:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787579400.162006:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91ddbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3322:x1874412616866176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579400.162042:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91ddbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3322:x1874412616866176:12345-0@lo:400:kworker.0 Request processed in 37us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579400.162048:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787579400.162090:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616866176:0@lo:400:kworker.0 00000100:00100000:3.0:1787579400.176169:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787579400.176189:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3322:1874412616866688:0@lo:400:kworker.0 00000100:00100000:3.0:1787579400.176310:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579400.176354:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616866688 00000100:00100000:3.0:1787579400.176360:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616866688 00000100:00080000:2.0:1787579400.176410:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787579400.176415:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787579400.176430:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1874412616866688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579400.176566:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1874412616866688:12345-0@lo:400:kworker.0 Request processed in 142us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579400.176583:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787579400.176792:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787579400.176802:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616866560:0@lo:400:kworker.0 00000100:00100000:1.0:1787579400.176834:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579400.176905:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616866560 00000100:00100000:2.0:1787579400.176910:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616866560 00000100:00100000:2.0:1787579400.176974:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787579400.176982:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616866560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579400.177017:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616866560:12345-0@lo:400:kworker.0 Request processed in 36us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579400.177024:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1787579400.177066:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceb480ed80 x1874412616866560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579400.177079:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616866560:0@lo:400:kworker.0 00000100:00080000:1.0:1787579400.177482:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787579400.178617:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3322:1874412616866688:0@lo:400:kworker.0 00010000:00010000:3.0:1787579400.608622:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579400.672223:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616866816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787579400.672308:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579400.672608:0:7952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616866816 00000100:00100000:2.0:1787579400.672616:0:7952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616866816 00000100:00100000:2.0:1787579400.672664:0:7952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787579400.672673:0:7952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616866816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787579400.672704:0:7952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579400.672743:0:7952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616866816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579400.672750:0:7952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1787579400.672852:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceba831180 x1874412616866816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579400.672870:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616866816:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787579401.632153:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579402.656645:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579403.680209:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579404.707073:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579404.980995:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579404.981055:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579404.981088:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579404.981121:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579404.981202:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591668480 00000100:00100000:0.0:1787579404.981212:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591668480 00000100:00100000:0.0:1787579404.981258:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 275 00000100:00100000:0.0:1787579404.981283:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91ddb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+13:2359:x1874412591668480:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579404.981345:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91ddb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+13:2359:x1874412591668480:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 64us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579404.981353:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 275 00000100:00100000:1.0:1787579404.981671:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591668608 00000100:00100000:1.0:1787579404.981676:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591668608 00000100:00100000:1.0:1787579404.981733:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 104 00000100:00100000:1.0:1787579404.981741:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+5:2359:x1874412591668608:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579404.981781:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+5:2359:x1874412591668608:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 42us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579404.981788:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 104 00000100:00100000:3.0:1787579404.982143:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591668736 00000100:00100000:3.0:1787579404.982148:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591668736 00000100:00100000:3.0:1787579404.982480:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 48 00000100:00100000:3.0:1787579404.982490:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+5:2359:x1874412591668736:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1787579404.982530:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+5:2359:x1874412591668736:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 43us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579404.982537:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 48 00000100:00100000:1.0:1787579404.983063:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591668864 00000100:00100000:1.0:1787579404.983067:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591668864 00000100:00100000:1.0:1787579404.983106:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 105 00000100:00100000:1.0:1787579404.983114:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2359:x1874412591668864:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579404.983162:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2359:x1874412591668864:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 49us (2040us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579404.983169:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 105 00000100:00080000:0.0:1787579404.983434:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787579404.983439:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787579405.286136:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787579405.286155:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616866944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787579405.286212:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579405.286266:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616866944 00000100:00100000:3.0:1787579405.286272:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616866944 00000100:00100000:3.0:1787579405.286490:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787579405.286500:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616866944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787579405.286532:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787579405.286575:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616866944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579405.286583:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1787579405.286611:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787579405.286717:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616866944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787579405.288466:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba810e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616867200:0@lo:400:kworker.0 00000100:00100000:0.0:1787579405.288530:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579405.288561:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787579405.288567:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba810380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616867328:0@lo:400:kworker.0 00000100:00100000:0.0:1787579405.288591:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579405.288620:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616867200 00000100:00100000:0.0:1787579405.288626:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616867200 00000100:00100000:0.0:1787579405.288672:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616867328 00000100:00100000:0.0:1787579405.288682:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616867328 00000100:00100000:0.0:1787579405.288712:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787579405.288720:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616867200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579405.288765:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616867200:12345-0@lo:400:kworker.0 Request processed in 45us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579405.288772:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787579405.288786:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787579405.288792:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616867328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579405.288819:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616867328:12345-0@lo:400:kworker.0 Request processed in 27us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579405.288824:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787579405.288863:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba810380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616867328:0@lo:400:kworker.0 00000100:00100000:0.0:1787579405.288873:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba810e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616867200:0@lo:400:kworker.0 00000100:00100000:0.0:1787579405.288895:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616867456:0@lo:400:kworker.0 00000100:00100000:0.0:1787579405.288920:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579405.289123:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba813800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616867072:0@lo:400:kworker.0 00000100:00100000:2.0:1787579405.289157:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579405.289182:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba810700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3320:1874412616867584:0@lo:400:kworker.0 00000100:00100000:2.0:1787579405.289202:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579405.289325:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616867456 00000100:00100000:0.0:1787579405.289330:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616867456 00000100:00100000:0.0:1787579405.289367:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787579405.289374:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616867456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579405.289412:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616867456:12345-0@lo:400:kworker.0 Request processed in 39us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579405.289418:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787579405.289435:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616867072 00000100:00100000:0.0:1787579405.289439:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616867072 00000100:00100000:0.0:1787579405.289462:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787579405.289469:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3320:x1874412616867072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579405.289525:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3320:x1874412616867072:12345-0@lo:400:kworker.0 Request processed in 56us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579405.289531:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00010000:00080000:0.0:1787579405.289568:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceba813480 x1874412616867456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579405.289580:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616867456:0@lo:400:kworker.0 00000100:00100000:0.0:1787579405.289604:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba813800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616867072:0@lo:400:kworker.0 00000100:00080000:3.0:1787579405.289956:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787579405.290071:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616867584 00000100:00100000:2.0:1787579405.290076:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616867584 00000100:00100000:2.0:1787579405.290105:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787579405.290112:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874412616867584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579405.290152:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874412616867584:12345-0@lo:400:kworker.0 Request processed in 40us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579405.290157:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1787579405.290193:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579405.290266:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba810700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3320:1874412616867584:0@lo:400:kworker.0 00010000:00010000:3.0:1787579405.731150:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579405.792849:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616867712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787579405.792916:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579405.798041:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616867712 00000100:00100000:1.0:1787579405.798056:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616867712 00000100:00100000:1.0:1787579405.798127:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787579405.798139:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616867712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787579405.798176:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787579405.798266:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616867712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (5348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579405.798273:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1787579405.798452:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceba831180 x1874412616867712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579405.798472:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616867712:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787579406.752689:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787579407.457544:0:11712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787579407.776122:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579408.801557:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579409.825777:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579410.111066:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579410.111107:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579410.111397:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591669120 00000100:00100000:1.0:1787579410.111406:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591669120 00000100:00100000:1.0:1787579410.111471:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 109 00000100:00100000:1.0:1787579410.111481:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+5:2361:x1874412591669120:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579410.111556:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+5:2361:x1874412591669120:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 76us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579410.111564:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 109 00000100:00100000:0.0:1787579410.112355:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591668992 00000100:00100000:0.0:1787579410.112361:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591668992 00000100:00100000:0.0:1787579410.112398:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 277 00000100:00100000:0.0:1787579410.112405:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+13:2361:x1874412591668992:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579410.112449:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+13:2361:x1874412591668992:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 44us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579410.112456:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 277 00000100:00080000:3.0:1787579410.113020:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787579410.130454:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579410.130501:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579410.130610:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591669376 00000100:00100000:0.0:1787579410.130619:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591669376 00000100:00080000:1.0:1787579410.130796:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579410.130884:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 110 00000100:00100000:0.0:1787579410.130903:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8923b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2361:x1874412591669376:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579410.131058:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8923b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2361:x1874412591669376:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 156us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579410.131066:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 110 00000100:00100000:3.0:1787579410.132723:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591669248 00000100:00100000:3.0:1787579410.132734:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591669248 00000100:00100000:3.0:1787579410.132940:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 20 00000100:00100000:3.0:1787579410.132953:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89238000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+5:2358:x1874412591669248:12345-192.168.206.53@tcp:9:kworker.0 00000020:00000080:3.0:1787579410.132978:0:6710:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6ee2 00000100:00080000:3.0:1787579410.132986:0:6710:0:(import.c:65:import_set_state_nolock()) ffffa0ce85764000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1787579410.133011:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:3.0:1787579410.133041:0:6710:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:2.0:1787579410.133051:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579410.133834:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89238000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+2:2358:x1874412591669248:12345-192.168.206.53@tcp:9:kworker.0 Request processed in 881us (3328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579410.133906:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 20 00000100:00100000:0.0:1787579410.400324:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616867840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787579410.400395:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579410.400960:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616868224:0@lo:400:kworker.0 00000100:00100000:1.0:1787579410.401026:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579410.401070:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787579410.401076:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616868352:0@lo:400:kworker.0 00000100:00100000:1.0:1787579410.401102:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579410.401134:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616868352 00000100:00100000:1.0:1787579410.401141:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616868352 00000100:00100000:1.0:1787579410.401195:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787579410.401205:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616868352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579410.401257:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616868352:12345-0@lo:400:kworker.0 Request processed in 54us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579410.401265:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1787579410.401283:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787579410.401312:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceb480fb80 x1874412616868352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579410.401325:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616868352:0@lo:400:kworker.0 00000100:00100000:0.0:1787579410.401464:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616867968:0@lo:400:kworker.0 00000100:00100000:0.0:1787579410.401497:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579410.401527:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1874412616868480:0@lo:400:kworker.0 00000100:00100000:0.0:1787579410.401550:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579410.401566:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787579410.401572:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616868096:0@lo:400:kworker.0 00000100:00100000:0.0:1787579410.401594:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579410.401728:0:7952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616867840 00000100:00100000:2.0:1787579410.401733:0:7952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616867840 00000100:00100000:2.0:1787579410.401777:0:7952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787579410.401786:0:7952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616867840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787579410.401814:0:7952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579410.401855:0:7952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616867840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579410.401873:0:7952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787579410.401893:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616868224 00000100:00100000:2.0:1787579410.401897:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616868224 00000100:00100000:2.0:1787579410.401922:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616868480 00000100:00100000:2.0:1787579410.401956:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616868480 00000100:00100000:2.0:1787579410.401977:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616868096 00000100:00100000:2.0:1787579410.401979:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616868096 00000100:00100000:2.0:1787579410.401991:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787579410.402007:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616868224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579410.402043:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616868224:12345-0@lo:400:kworker.0 Request processed in 45us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579410.402048:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787579410.402059:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787579410.402065:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874412616868480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579410.402097:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874412616868480:12345-0@lo:400:kworker.0 Request processed in 32us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579410.402103:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787579410.402114:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787579410.402120:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616868096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579410.402147:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616868096:12345-0@lo:400:kworker.0 Request processed in 27us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579410.402153:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787579410.402401:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616867840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787579410.402428:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616868096:0@lo:400:kworker.0 00000100:00100000:2.0:1787579410.402436:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1874412616868480:0@lo:400:kworker.0 00000100:00080000:0.0:1787579410.403472:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787579410.403478:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787579410.405079:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616867968 00000100:00100000:1.0:1787579410.405092:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616867968 00000100:00100000:1.0:1787579410.405179:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1787579410.405190:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce91dda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3319:x1874412616867968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579410.405289:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce91dda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3319:x1874412616867968:12345-0@lo:400:kworker.0 Request processed in 101us (3789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579410.405297:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1787579410.405364:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616868224:0@lo:400:kworker.0 00000100:00100000:3.0:1787579410.405522:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616867968:0@lo:400:kworker.0 00010000:00010000:3.0:1787579410.848600:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579410.920288:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce8923aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616868608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787579410.920362:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579410.920559:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616868608 00000100:00100000:0.0:1787579410.920567:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616868608 00000100:00100000:0.0:1787579410.920618:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787579410.920628:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616868608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787579410.920662:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579410.920715:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616868608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579410.920723:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1787579410.922601:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ce8923aa00 x1874412616868608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579410.922627:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce8923aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616868608:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787579411.872468:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579412.896151:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579413.923069:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579414.944095:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787579415.039149:0:7670:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 963d8c17-1326-491b-be60-9002b9296555 00000020:00000080:1.0:1787579415.039158:0:7670:0:(genops.c:885:class_export_put()) final put ffffa0ce85767000/963d8c17-1326-491b-be60-9002b9296555 00000020:00000080:2.0:1787579415.039226:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ce85767000/963d8c17-1326-491b-be60-9002b9296555 for lustre-OST0001 00000020:00000080:2.0:1787579415.039278:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0ce85764000 for lustre-OST0001 00000100:00100000:3.0:1787579415.221275:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579415.221316:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579415.221351:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579415.221407:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591669760 00000100:00100000:2.0:1787579415.221416:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591669760 00000100:00100000:3.0:1787579415.221426:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591669504 00000100:00100000:3.0:1787579415.221432:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591669504 00000100:00100000:2.0:1787579415.221469:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591669632 00000100:00100000:2.0:1787579415.221473:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591669632 00000100:00100000:3.0:1787579415.221480:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 279 00000100:00100000:3.0:1787579415.221492:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+13:2359:x1874412591669504:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1787579415.221501:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 114 00000100:00100000:2.0:1787579415.221511:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2359:x1874412591669760:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1787579415.221555:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+13:2359:x1874412591669504:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 65us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579415.221562:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 279 00000100:00080000:0.0:1787579415.221576:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787579415.222202:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2359:x1874412591669760:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 691us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579415.222210:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 114 00000100:00100000:2.0:1787579415.222225:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 115 00000100:00100000:2.0:1787579415.222231:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+5:2359:x1874412591669632:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1787579415.222259:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+5:2359:x1874412591669632:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 28us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579415.222265:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 115 00000100:00100000:3.0:1787579415.520147:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616868992:0@lo:400:kworker.0 00000100:00100000:3.0:1787579415.520211:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579415.520258:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787579415.520264:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616869120:0@lo:400:kworker.0 00000100:00100000:3.0:1787579415.520292:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579415.520328:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616868992 00000100:00100000:3.0:1787579415.520335:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616868992 00000100:00100000:3.0:1787579415.520381:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787579415.520389:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616868992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579415.520433:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616868992:12345-0@lo:400:kworker.0 Request processed in 45us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579415.520440:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787579415.520458:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616869120 00000100:00100000:3.0:1787579415.520461:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616869120 00000100:00100000:3.0:1787579415.520486:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787579415.520493:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616869120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579415.520523:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616869120:12345-0@lo:400:kworker.0 Request processed in 30us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579415.520529:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1787579415.520578:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787579415.520582:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787579415.520593:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787579415.520601:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616869504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787579415.520628:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579415.520659:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616869504 00000100:00100000:3.0:1787579415.520663:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616869504 00000100:00100000:3.0:1787579415.520693:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787579415.520699:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616869504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787579415.520722:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787579415.520755:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616869504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579415.520761:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1787579415.520776:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787579415.520804:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616869504:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787579415.520831:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceb480c000 x1874412616869120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579415.520842:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616869120:0@lo:400:kworker.0 00000100:00100000:3.0:1787579415.520852:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616868992:0@lo:400:kworker.0 00000100:00100000:1.0:1787579415.520917:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616868736:0@lo:400:kworker.0 00000100:00100000:1.0:1787579415.520996:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579415.521021:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616869248:0@lo:400:kworker.0 00000100:00100000:1.0:1787579415.521042:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579415.521059:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787579415.521064:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616868864:0@lo:400:kworker.0 00000100:00100000:1.0:1787579415.521083:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579415.521100:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1874412616869376:0@lo:400:kworker.0 00000100:00100000:1.0:1787579415.521118:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579415.521143:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616868736 00000100:00100000:1.0:1787579415.521147:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616868736 00000100:00100000:1.0:1787579415.521181:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787579415.521187:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3321:x1874412616868736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579415.521221:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3321:x1874412616868736:12345-0@lo:400:kworker.0 Request processed in 35us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579415.521227:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787579415.521252:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616869248 00000100:00100000:1.0:1787579415.521255:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616869248 00000100:00100000:1.0:1787579415.521274:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787579415.521280:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616869248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579415.521305:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616869248:12345-0@lo:400:kworker.0 Request processed in 26us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579415.521311:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787579415.521325:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616868864 00000100:00100000:1.0:1787579415.521328:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616868864 00000100:00100000:1.0:1787579415.521342:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616869376 00000100:00100000:1.0:1787579415.521345:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616869376 00000100:00100000:1.0:1787579415.521364:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787579415.521369:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616868864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579415.521396:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616868864:12345-0@lo:400:kworker.0 Request processed in 26us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579415.521401:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787579415.521410:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787579415.521416:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874412616869376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579415.521441:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874412616869376:12345-0@lo:400:kworker.0 Request processed in 26us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579415.521447:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1787579415.521478:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579415.521506:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616868864:0@lo:400:kworker.0 00000100:00100000:1.0:1787579415.521516:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1874412616869376:0@lo:400:kworker.0 00000100:00100000:1.0:1787579415.521524:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616868736:0@lo:400:kworker.0 00000100:00100000:1.0:1787579415.521531:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616869248:0@lo:400:kworker.0 00010000:00010000:3.0:1787579415.969145:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579416.035984:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce89239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616869632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787579416.036053:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579416.036159:0:7952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616869632 00000100:00100000:2.0:1787579416.036167:0:7952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616869632 00000100:00100000:2.0:1787579416.036217:0:7952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787579416.036228:0:7952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba813800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616869632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787579416.036260:0:7952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579416.036312:0:7952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba813800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616869632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579416.036319:0:7952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1787579416.036380:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ce89239180 x1874412616869632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579416.036398:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce89239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616869632:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787579416.997065:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787579417.696727:0:11712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787579418.016969:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787579418.676072:0:11877:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 09:50:16 (1787579416) 00010000:00010000:3.0:1787579419.045605:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579419.980333:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579419.980481:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591669888 00000100:00100000:3.0:1787579419.980491:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591669888 00000100:00100000:3.0:1787579419.980589:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 32 00000100:00100000:3.0:1787579419.980600:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+5:10245:x1874412591669888:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00000100:00080000:1.0:1787579419.980692:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787579419.980730:0:9532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579419.980785:0:9532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b6fad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cf25 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579419.980838:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b6fb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579419.980849:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b6fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579419.980859:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b6fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579419.981176:0:9532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787579419.981181:0:9532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787579419.981297:0:9532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b6fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579419.981320:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b6fad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf25 expref: 7 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579419.981343:0:9532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b6fb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf25 expref: 6 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579419.981355:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:3.0:1787579419.981361:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787579419.981364:0:9532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce813fca00, rc 0) 00000100:00100000:3.0:1787579419.982041:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+6:10245:x1874412591669888:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 1440us (1720us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579419.982060:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 32 00000100:00100000:2.0:1787579419.991998:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579419.992088:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591670016 00000100:00100000:1.0:1787579419.992097:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591670016 00000100:00100000:1.0:1787579419.992152:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 33 00000100:00100000:1.0:1787579419.992161:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+6:10246:x1874412591670016:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787579419.992180:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579419.992199:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8148b000/0xb72beeaffa1b6fbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cf2c expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579419.992256:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8148a600/0xb72beeaffa1b6fc2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579419.992270:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8148a600/0xb72beeaffa1b6fc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579419.992280:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8148a600/0xb72beeaffa1b6fc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579419.992295:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8148b800/0xb72beeaffa1b6fc9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579419.992301:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8148b800/0xb72beeaffa1b6fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579419.992325:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8148b800/0xb72beeaffa1b6fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579419.992732:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8400/0xb72beeaffa1b6fd0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579419.992743:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8400/0xb72beeaffa1b6fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579419.992751:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8400/0xb72beeaffa1b6fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787579419.992840:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787579419.992845:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787579419.992921:0:5868:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8400/0xb72beeaffa1b6fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579419.992971:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8148a600/0xb72beeaffa1b6fc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579419.992978:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8148a600/0xb72beeaffa1b6fc2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579419.992985:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8148a600/0xb72beeaffa1b6fc2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579419.992991:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148a600 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579419.992995:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8148a600/0xb72beeaffa1b6fc2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579419.993002:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8148a600/0xb72beeaffa1b6fc2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579419.993020:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:1.0:1787579419.993023:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579419.993027:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8148a600/0xb72beeaffa1b6fc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579419.993033:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8148a600/0xb72beeaffa1b6fc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579419.993045:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8148b800/0xb72beeaffa1b6fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579419.993051:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8148b800/0xb72beeaffa1b6fc9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579419.993057:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8148b800/0xb72beeaffa1b6fc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579419.993062:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148b800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579419.993065:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8148b800/0xb72beeaffa1b6fc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579419.993070:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8148b800/0xb72beeaffa1b6fc9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579419.993077:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffffa0ce86456f00) 00010000:00010000:1.0:1787579419.993079:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579419.993081:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8148b800/0xb72beeaffa1b6fc9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579419.993088:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8148b800/0xb72beeaffa1b6fc9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579419.993127:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8148b000/0xb72beeaffa1b6fbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf2c expref: 8 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579419.993140:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8400/0xb72beeaffa1b6fd0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf2c expref: 7 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579419.993147:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0ce86456d00) 00010000:00010000:1.0:1787579419.993150:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787579419.993152:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb47c8400, rc 0) 00000100:00100000:1.0:1787579419.993220:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+7:10246:x1874412591670016:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 1060us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579419.993228:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 33 00000100:00100000:0.0:1787579420.008482:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579420.008824:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591670272 00000100:00100000:3.0:1787579420.008834:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591670272 00000100:00100000:3.0:1787579420.008908:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 34 00000100:00100000:3.0:1787579420.008918:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+7:10246:x1874412591670272:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787579420.008979:0:9530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579420.009001:0:9530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b6fd7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cf33 expref: -99 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579420.009068:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b6fde lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579420.009084:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b6fde lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579420.009094:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b6fde lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579420.009152:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b6fe5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579420.009160:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b6fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579420.009167:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b6fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579420.009671:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e600/0xb72beeaffa1b6fec lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579420.009693:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e600/0xb72beeaffa1b6fec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579420.009700:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e600/0xb72beeaffa1b6fec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579420.009711:0:9530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787579420.010813:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b6fde lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579420.010826:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b6fde lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579420.010832:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b6fde lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579420.010838:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8152e200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579420.010842:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b6fde lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579420.010848:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b6fde lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579420.010876:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0ce86456d00) 00010000:00010000:3.0:1787579420.010885:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579420.010890:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b6fde lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579420.010896:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b6fde lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579420.010909:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b6fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579420.010921:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b6fe5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579420.010975:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b6fe5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579420.010980:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8152ea00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579420.010983:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b6fe5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579420.010989:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b6fe5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579420.010998:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffffa0ce84d55d00) 00010000:00010000:3.0:1787579420.011000:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579420.011003:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b6fe5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579420.011009:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b6fe5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579420.011381:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b6fd7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf33 expref: 10 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579420.011398:0:9530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e600/0xb72beeaffa1b6fec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf33 expref: 9 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579420.011406:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0ce84d55300) 00010000:00010000:3.0:1787579420.011409:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579420.011417:0:9530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8152e600, rc 0) 00000100:00100000:3.0:1787579420.012138:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+9:10246:x1874412591670272:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 3217us (3660us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787579420.012148:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 34 00000100:00100000:2.0:1787579420.019489:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579420.019575:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591670400 00000100:00100000:1.0:1787579420.019585:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591670400 00000100:00100000:1.0:1787579420.019641:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 35 00000100:00100000:1.0:1787579420.019652:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8923b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+9:10246:x1874412591670400:12345-192.168.206.53@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787579420.019763:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8923b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+9:10246:x1874412591670400:12345-192.168.206.53@tcp:59:lhsmtool_posix.0 Request processed in 113us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579420.019771:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 35 00010000:00010000:3.0:1787579420.064510:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787579420.195335:0:5888:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:2.0:1787579420.339610:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579420.339655:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579420.339756:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591670656 00000100:00100000:1.0:1787579420.339765:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591670656 00000100:00100000:1.0:1787579420.339840:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 119 00000100:00100000:1.0:1787579420.339851:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2362:x1874412591670656:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579420.339971:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2362:x1874412591670656:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 122us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579420.339994:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 119 00000100:00080000:2.0:1787579420.340294:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787579420.340803:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591670528 00000100:00100000:3.0:1787579420.340810:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591670528 00000100:00100000:3.0:1787579420.340851:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 281 00000100:00100000:3.0:1787579420.340858:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+13:2362:x1874412591670528:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1787579420.340904:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+13:2362:x1874412591670528:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 47us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579420.340912:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 281 00000100:00100000:3.0:1787579420.640514:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616869760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787579420.640577:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579420.640645:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616869760 00000100:00100000:3.0:1787579420.640651:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616869760 00000100:00100000:3.0:1787579420.640697:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787579420.640706:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616869760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787579420.640737:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787579420.640776:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616869760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579420.640782:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1787579420.640800:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787579420.640830:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616869760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787579420.641053:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce812a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616870016:0@lo:400:kworker.0 00000100:00100000:1.0:1787579420.641084:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579420.641103:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787579420.641109:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce812a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616870144:0@lo:400:kworker.0 00000100:00100000:1.0:1787579420.641128:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579420.641164:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616870016 00000100:00100000:1.0:1787579420.641168:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616870016 00000100:00100000:1.0:1787579420.641193:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616870144 00000100:00100000:1.0:1787579420.641196:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616870144 00000100:00100000:1.0:1787579420.641217:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787579420.641223:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616870016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579420.641258:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616870016:12345-0@lo:400:kworker.0 Request processed in 35us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579420.641264:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787579420.641276:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787579420.641282:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616870144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579420.641305:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616870144:12345-0@lo:400:kworker.0 Request processed in 23us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579420.641310:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787579420.641350:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce812a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616870144:0@lo:400:kworker.0 00000100:00100000:1.0:1787579420.641359:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce812a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616870016:0@lo:400:kworker.0 00000100:00100000:3.0:1787579420.642330:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce812aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616869888:0@lo:400:kworker.0 00000100:00100000:3.0:1787579420.642384:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579420.642414:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3322:1874412616870400:0@lo:400:kworker.0 00000100:00100000:3.0:1787579420.642437:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579420.642455:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787579420.642461:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce812a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616870272:0@lo:400:kworker.0 00000100:00100000:3.0:1787579420.642484:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579420.642510:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616870272 00000100:00100000:3.0:1787579420.642515:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616870272 00000100:00100000:3.0:1787579420.642550:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787579420.642557:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba315500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616870272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579420.642592:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba315500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616870272:12345-0@lo:400:kworker.0 Request processed in 36us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579420.642598:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1787579420.642616:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787579420.642619:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787579420.642640:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ce812a8380 x1874412616870272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579420.642651:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce812a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616870272:0@lo:400:kworker.0 00000100:00100000:0.0:1787579420.642834:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616870400 00000100:00100000:0.0:1787579420.642839:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616870400 00000100:00100000:0.0:1787579420.642879:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787579420.642885:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1874412616870400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579420.642918:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1874412616870400:12345-0@lo:400:kworker.0 Request processed in 33us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579420.642954:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787579420.642996:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3322:1874412616870400:0@lo:400:kworker.0 00000100:00100000:1.0:1787579420.643062:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616869888 00000100:00100000:1.0:1787579420.643066:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616869888 00000100:00100000:1.0:1787579420.643099:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787579420.643114:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3322:x1874412616869888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579420.643145:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3322:x1874412616869888:12345-0@lo:400:kworker.0 Request processed in 34us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579420.643151:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1787579420.643284:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce812aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616869888:0@lo:400:kworker.0 00000100:00080000:3.0:1787579420.643803:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1787579420.770690:0:11712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787579421.089372:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579421.152222:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787579421.152669:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce89238700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616870528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787579421.152734:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579421.152792:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616870528 00000100:00100000:3.0:1787579421.152800:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616870528 00000100:00100000:3.0:1787579421.152853:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787579421.152861:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba810e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616870528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787579421.152899:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787579421.152974:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba810e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616870528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579421.152992:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1787579421.153119:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ce89238700 x1874412616870528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579421.153136:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce89238700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616870528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787579421.745183:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579421.745254:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591670784 00000100:00100000:3.0:1787579421.745264:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591670784 00000100:00100000:3.0:1787579421.745338:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 36 00000100:00100000:3.0:1787579421.745347:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8923bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+8:10287:x1874412591670784:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1787579421.745365:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579421.745383:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b6ffa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cf3a expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.745442:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7001 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.745455:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7001 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.745465:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7001 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.745479:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7008 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.745486:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7008 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.745492:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7008 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.745736:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7001 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.745744:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7001 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.745756:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7001 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.745761:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8152e200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579421.745765:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7001 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.745772:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7001 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.745784:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:3.0:1787579421.745788:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579421.745793:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7001 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.745799:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7001 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.745810:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7008 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.745816:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7008 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.745821:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7008 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.745825:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8152f000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579421.745828:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7008 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.745842:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7008 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.745850:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffffa0ce84d55a00) 00010000:00010000:3.0:1787579421.745852:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579421.745854:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7008 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.745860:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7008 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.745888:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b6ffa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf3a expref: 9 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.745897:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:3.0:1787579421.745900:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579421.745903:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b6ffa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf3a expref: 9 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.745911:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8152ea00, rc 0) 00000100:00100000:3.0:1787579421.746000:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8923bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+8:10287:x1874412591670784:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 654us (824us total) trans 0 rc 301/301 00000100:00100000:3.0:1787579421.746008:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 36 00000100:00080000:2.0:1787579421.746128:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579421.756745:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579421.756816:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591671040 00000100:00100000:1.0:1787579421.756825:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591671040 00000100:00100000:1.0:1787579421.756891:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 37 00000100:00100000:1.0:1787579421.756902:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+8:10287:x1874412591671040:12345-192.168.206.53@tcp:36:lfs.0 00010000:00010000:1.0:1787579421.756988:0:9530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787579421.757014:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b6fb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf25 expref: 8 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.757030:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:1.0:1787579421.757040:0:9530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787579421.757471:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b700f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.757485:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b700f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.757493:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b700f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.757506:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b7016 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.757512:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b7016 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.757519:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b7016 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787579421.758805:0:9530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787579421.758817:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b700f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.758824:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b700f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.758831:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b700f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.758836:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c8c00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579421.758840:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b700f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.758847:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b700f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.758858:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce86456c00) 00010000:00010000:1.0:1787579421.758861:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579421.758865:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b700f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.758870:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b700f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787579421.758991:0:9530:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f6e3a51 reply state 00000000b0f19c74 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b7016 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579421.758999:0:9530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787579421.759093:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+9:10287:x1874412591671040:12345-192.168.206.53@tcp:36:lfs.0 Request processed in 2190us (2361us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787579421.759111:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 37 00010000:00010000:2.0:1787579421.763359:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b7016 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579421.763372:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b7016 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579421.763379:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b7016 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579421.763384:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c8200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579421.763388:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b7016 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579421.763395:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b7016 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579421.763410:0:3305:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffffa0ce86456000) 00010000:00010000:2.0:1787579421.763413:0:3305:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579421.763417:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b7016 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579421.763423:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b7016 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579421.846262:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579421.846635:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591671168 00000100:00100000:2.0:1787579421.846645:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591671168 00000100:00100000:2.0:1787579421.846698:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 38 00000100:00100000:2.0:1787579421.846708:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+8:10296:x1874412591671168:12345-192.168.206.53@tcp:101:lctl.0 00010000:00010000:2.0:1787579421.846731:0:5866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579421.846753:0:5866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b701d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cf41 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579421.846812:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7024 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579421.846824:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7024 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579421.846837:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7024 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579421.846901:0:5866:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787579421.846906:0:5866:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787579421.846979:0:5866:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7024 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579421.847002:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b701d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf41 expref: 10 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579421.847016:0:5866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7024 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf41 expref: 9 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579421.847024:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0cea147d400) 00010000:00010000:2.0:1787579421.847032:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787579421.847036:0:5866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba318000, rc 0) 00000100:00100000:2.0:1787579421.847084:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+9:10296:x1874412591671168:12345-192.168.206.53@tcp:101:lctl.0 Request processed in 377us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579421.847091:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 38 00000100:00100000:0.0:1787579421.936827:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579421.937062:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591671296 00000100:00100000:3.0:1787579421.937072:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591671296 00000100:00100000:3.0:1787579421.937130:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 39 00000100:00100000:3.0:1787579421.937139:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+9:10302:x1874412591671296:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:3.0:1787579421.937171:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579421.937191:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b702b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cf48 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.937247:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7032 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.937260:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7032 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.937270:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7032 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.937282:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7039 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.937288:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7039 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.937294:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7039 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.937391:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e400/0xb72beeaffa1b7040 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.937398:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e400/0xb72beeaffa1b7040 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.937404:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e400/0xb72beeaffa1b7040 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579421.937446:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787579421.937456:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787579421.937500:0:5868:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e400/0xb72beeaffa1b7040 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.937512:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7032 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.937518:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7032 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.937524:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7032 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.937531:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8152f000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579421.937535:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7032 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.937542:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7032 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.937554:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0cea147d400) 00010000:00010000:3.0:1787579421.937556:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579421.937560:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7032 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.937566:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7032 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.937579:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7039 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.937585:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7039 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.937602:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7039 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.937608:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8152e200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579421.937611:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7039 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.937617:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7039 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.937626:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffffa0ce84d55d00) 00010000:00010000:3.0:1787579421.937628:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579421.937631:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7039 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.937636:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7039 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.937666:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b702b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf48 expref: 11 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.937678:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e400/0xb72beeaffa1b7040 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf48 expref: 10 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.937684:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:3.0:1787579421.937686:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787579421.937689:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8152e400, rc 0) 00000100:00100000:3.0:1787579421.937763:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+10:10302:x1874412591671296:12345-192.168.206.53@tcp:101:bash.0 Request processed in 625us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579421.937778:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 39 00000100:00100000:2.0:1787579421.941825:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579421.941960:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591671552 00000100:00100000:1.0:1787579421.941969:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591671552 00000100:00100000:1.0:1787579421.942018:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 40 00000100:00100000:1.0:1787579421.942027:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8923ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+10:10302:x1874412591671552:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:1.0:1787579421.942043:0:9530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579421.942060:0:9530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b7047 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cf4f expref: -99 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.942168:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b704e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.942181:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b704e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.942192:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b704e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.942244:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7055 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.942251:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7055 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.942257:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7055 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787579421.942729:0:9530:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1787579421.942863:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b705c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.942877:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b705c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.942884:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b705c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.942912:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b704e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.942918:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b704e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.942972:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b704e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.942979:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c8200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579421.942983:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b704e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.942989:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b704e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.942999:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:1.0:1787579421.943002:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579421.943006:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b704e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.943011:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b704e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787579421.943021:0:9530:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000144396e4 reply state 00000000d262a246 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7055 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579421.943034:0:9530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787579421.943057:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b7047 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf4f expref: 13 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.943069:0:9530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b705c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf4f expref: 12 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.943075:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456500) 00010000:00010000:1.0:1787579421.943078:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787579421.943080:0:9530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb47c8000, rc 0) 00000100:00100000:1.0:1787579421.943132:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8923ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+13:10302:x1874412591671552:12345-192.168.206.53@tcp:101:bash.0 Request processed in 1106us (1315us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787579421.943139:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 40 00010000:00010000:2.0:1787579421.945447:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7055 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579421.945461:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7055 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579421.945468:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7055 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579421.945475:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c9400 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579421.945479:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7055 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579421.945487:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7055 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579421.945500:0:3306:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0ce86456c00) 00010000:00010000:2.0:1787579421.945503:0:3306:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579421.945507:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7055 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579421.945513:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7055 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579421.947884:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579421.948168:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591671680 00000100:00100000:1.0:1787579421.948178:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591671680 00000100:00100000:1.0:1787579421.948224:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 21 00000100:00100000:1.0:1787579421.948232:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1874412591671680:12345-192.168.206.53@tcp:8:bash.0 00010000:00080000:1.0:1787579421.948260:0:6712:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 963d8c17-1326-491b-be60-9002b9296555@192.168.206.53@tcp t0 exp 0000000000000000 cur 358 last 0 00000020:00000080:1.0:1787579421.948287:0:6712:0:(genops.c:1385:class_connect()) connect: client 963d8c17-1326-491b-be60-9002b9296555, cookie 0xb72beeaffa1b706a 00002000:00100000:1.0:1787579421.948297:0:6712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 963d8c17-1326-491b-be60-9002b9296555/ffffa0cebf6b7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787579421.948308:0:6712:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787579421.948618:0:6712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787579421.948644:0:6712:0:(import.c:65:import_set_state_nolock()) ffffa0cebf6b6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787579421.948751:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+6:2358:x1874412591671680:12345-192.168.206.53@tcp:8:bash.0 Request processed in 517us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579421.948768:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 21 00000100:00100000:1.0:1787579421.953377:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579421.953469:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591671808 00000100:00100000:3.0:1787579421.953478:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591671808 00000100:00080000:2.0:1787579421.953540:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787579421.953663:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 22 00000100:00100000:3.0:1787579421.953674:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+6:0:x1874412591671808:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:3.0:1787579421.953691:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579421.953774:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f7a4506/0xb72beeaffa1b7071 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cf56 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787579421.953796:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787579421.953810:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=358s v=(0 0) 00010000:00010000:3.0:1787579421.953813:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579421.953819:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f7a4506/0xb72beeaffa1b7071 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf56 expref: 7 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.953834:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005f7a4506/0xb72beeaffa1b7071 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf56 expref: 7 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579421.953844:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8152ea00, rc 0) 00000100:00100000:3.0:1787579421.953970:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+7:0:x1874412591671808:12345-192.168.206.53@tcp:101:bash.0 Request processed in 298us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579421.953977:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 22 00000100:00100000:0.0:1787579421.956296:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579421.956379:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591671936 00000100:00100000:2.0:1787579421.956388:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591671936 00000100:00100000:2.0:1787579421.956434:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 23 00000100:00100000:2.0:1787579421.956444:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+7:10302:x1874412591671936:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:2.0:1787579421.956463:0:7660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579421.956490:0:7660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022c8f1a2/0xb72beeaffa1b7078 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cf5d expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579421.956518:0:7660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005f7a4506/0xb72beeaffa1b7071 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf56 expref: 8 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579421.956536:0:7660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579421.956540:0:7660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579421.956546:0:7660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022c8f1a2/0xb72beeaffa1b7078 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf5d expref: 8 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579421.956588:0:7660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005f7a4506/0xb72beeaffa1b7071 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf56 expref: 8 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579421.956602:0:7660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005f7a4506/0xb72beeaffa1b7071 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf56 expref: 8 pid: 6711 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579421.956620:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce8923a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7660:1874412616870656:192.168.206.53@tcp:104: 00000100:00100000:2.0:1787579421.956707:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fbd000 going to sleep for 11 seconds 00000100:00100000:1.0:1787579421.959848:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce8923a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7660:1874412616870656:192.168.206.53@tcp:104: 00010000:00010000:1.0:1787579421.960042:0:7660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000022c8f1a2/0xb72beeaffa1b7078 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf5d expref: 8 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.960066:0:7660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319400, rc 0) 00000100:00100000:1.0:1787579421.960127:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+8:10302:x1874412591671936:12345-192.168.206.53@tcp:101:bash.0 Request processed in 3684us (3838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579421.960137:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 23 00000100:00100000:0.0:1787579421.960167:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579421.960258:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591672064 00000100:00100000:1.0:1787579421.960265:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591672064 00010000:00010000:1.0:1787579421.960292:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005f7a4506/0xb72beeaffa1b7071 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf56 expref: 8 pid: 6711 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579421.960322:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 35 00000100:00100000:1.0:1787579421.960330:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf307b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+8:2359:x1874412591672064:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787579421.960342:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787579421.960363:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005f7a4506/0xb72beeaffa1b7071 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf56 expref: 8 pid: 6711 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.960375:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005f7a4506/0xb72beeaffa1b7071 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf56 expref: 8 pid: 6711 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.960398:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f7a4506/0xb72beeaffa1b7071 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf56 expref: 8 pid: 6711 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.960687:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579421.960692:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579421.960700:0:8477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000022c8f1a2/0xb72beeaffa1b7078 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf5d expref: 7 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.960711:0:8477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022c8f1a2/0xb72beeaffa1b7078 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf5d expref: 7 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579421.960743:0:8477:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000022c8f1a2/0xb72beeaffa1b7078 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf5d expref: 7 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579421.960757:0:8477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce812a9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8477:1874412616870784:192.168.206.53@tcp:105: 00000100:00100000:1.0:1787579421.960804:0:8477:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce865e9840 going to sleep for 11 seconds 00000100:00100000:1.0:1787579421.966269:0:8477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce812a9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8477:1874412616870784:192.168.206.53@tcp:105: 00010000:00010000:1.0:1787579421.966293:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787579421.966349:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf307b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+7:2359:x1874412591672064:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 6019us (6181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579421.966359:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 35 00000100:00100000:2.0:1787579421.970876:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579421.970973:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591672320 00000100:00100000:1.0:1787579421.970982:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591672320 00000100:00100000:1.0:1787579421.971035:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:1.0:1787579421.971044:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+12:10302:x1874412591672320:12345-192.168.206.53@tcp:35:bash.0 00000100:00100000:1.0:1787579421.971681:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+13:10302:x1874412591672320:12345-192.168.206.53@tcp:35:bash.0 Request processed in 635us (811us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787579421.971707:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:0.0:1787579422.027576:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579422.027658:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591672576 00000100:00100000:1.0:1787579422.027668:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591672576 00000100:00100000:1.0:1787579422.027723:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 41 00000100:00100000:1.0:1787579422.027732:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+13:10312:x1874412591672576:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1787579422.027754:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579422.027774:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b707f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cf64 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787579422.027873:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787579422.028023:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b707f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf64 expref: 15 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.028036:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0cea147d400) 00010000:00010000:1.0:1787579422.028039:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787579422.028044:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b707f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf64 expref: 15 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.028068:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb47c8c00, rc 0) 00000100:00100000:1.0:1787579422.028338:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+14:10312:x1874412591672576:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 606us (770us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1787579422.028346:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 41 00000100:00100000:2.0:1787579422.031010:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579422.031153:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591672832 00000100:00100000:1.0:1787579422.031162:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591672832 00000100:00100000:1.0:1787579422.031213:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:1.0:1787579422.031223:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8923b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+14:10312:x1874412591672832:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:1.0:1787579422.031596:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8923b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+15:10312:x1874412591672832:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 373us (592us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787579422.031604:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:2.0:1787579422.092047:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579422.092214:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591672960 00000100:00100000:0.0:1787579422.092224:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591672960 00000100:00100000:0.0:1787579422.092281:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 42 00000100:00100000:0.0:1787579422.092291:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8923a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+15:10318:x1874412591672960:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1787579422.092314:0:9532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579422.092333:0:9532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b708d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cf6b expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.092395:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7094 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.092407:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7094 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.092417:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7094 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579422.092467:0:9532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1787579422.092471:0:9532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787579422.092495:0:9532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7094 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.092520:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b708d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf6b expref: 17 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.092536:0:9532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7094 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf6b expref: 16 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.092560:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:0.0:1787579422.092563:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787579422.092567:0:9532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c9400, rc 0) 00000100:00100000:0.0:1787579422.092626:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8923a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+16:10318:x1874412591672960:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 336us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579422.092633:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 42 00000100:00100000:0.0:1787579422.101090:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579422.101263:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591673216 00000100:00100000:2.0:1787579422.101273:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591673216 00000100:00100000:2.0:1787579422.101333:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 43 00000100:00100000:2.0:1787579422.101344:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+16:10318:x1874412591673216:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1787579422.101363:0:5866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579422.101384:0:5866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b709b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cf72 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.101477:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b70a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.101491:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b70a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.101502:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b70a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579422.101513:0:5866:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787579422.101653:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b709b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf72 expref: 19 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.101670:0:5866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b70a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf72 expref: 18 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.101678:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456500) 00010000:00010000:2.0:1787579422.101681:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787579422.101684:0:5866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319000, rc 0) 00000100:00100000:2.0:1787579422.101744:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+18:10318:x1874412591673216:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 401us (661us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787579422.101763:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 43 00000100:00100000:2.0:1787579422.105148:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579422.105259:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591673344 00000100:00100000:3.0:1787579422.105268:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591673344 00000100:00100000:3.0:1787579422.105333:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 1 00000100:00100000:3.0:1787579422.105342:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89238e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+18:2361:x1874412591673344:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787579422.105368:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579422.105390:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b70a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf72 expref: 18 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579422.105407:0:5850:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456500) 00010000:00010000:3.0:1787579422.105412:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579422.106749:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89238e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+17:2361:x1874412591673344:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 1402us (1602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579422.106760:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 1 00000100:00100000:2.0:1787579422.107226:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579422.107473:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591673600 00000100:00100000:1.0:1787579422.107480:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591673600 00000100:00100000:1.0:1787579422.107520:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 44 00000100:00100000:1.0:1787579422.107529:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+17:10318:x1874412591673600:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1787579422.107549:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579422.107566:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b70b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cf79 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.107653:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b70b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.107666:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b70b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.107676:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b70b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787579422.107688:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787579422.107820:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b70b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf79 expref: 20 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.107837:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b70b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf79 expref: 19 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.107846:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456500) 00010000:00010000:1.0:1787579422.107862:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787579422.107866:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb47c8200, rc 0) 00000100:00100000:1.0:1787579422.107953:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+19:10318:x1874412591673600:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 396us (700us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787579422.107962:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 44 00010000:00010000:3.0:1787579422.117141:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579422.117248:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579422.117390:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591673728 00000100:00100000:0.0:1787579422.117399:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591673728 00000100:00100000:0.0:1787579422.117496:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 24 00000100:00100000:0.0:1787579422.117507:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89238380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+7:2359:x1874412591673728:12345-192.168.206.53@tcp:1:lfs.0 00010000:00010000:0.0:1787579422.117546:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d743d998/0xb72beeaffa1b70c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.117565:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000022c8f1a2/0xb72beeaffa1b7078 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf5d expref: 7 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.117574:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787579422.117578:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787579422.117582:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d743d998/0xb72beeaffa1b70c5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.117620:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000022c8f1a2/0xb72beeaffa1b7078 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf5d expref: 7 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.117651:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000022c8f1a2/0xb72beeaffa1b7078 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf5d expref: 7 pid: 7660 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579422.117665:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebf306300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6710:1874412616870912:192.168.206.53@tcp:104: 00000100:00100000:0.0:1787579422.117779:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb448ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787579422.121191:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebf306300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6710:1874412616870912:192.168.206.53@tcp:104: 00000100:00100000:0.0:1787579422.121202:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00010000:00010000:3.0:1787579422.121222:0:6710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d743d998/0xb72beeaffa1b70c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579422.121321:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591673856 00000100:00100000:1.0:1787579422.121328:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591673856 00002000:00100000:1.0:1787579422.121370:0:6715:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffffa0cebf305500 x1874412591673856/t0(0) o4->963d8c17-1326-491b-be60-9002b9296555@192.168.206.53@tcp:663/0 lens 504/0 e 0 to 0 dl 1787579433 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787579422.121380:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0cebf305500 with x1874412591673856 ext(0->12) 00010000:00010000:1.0:1787579422.121387:0:6715:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000022c8f1a2/0xb72beeaffa1b7078 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf5d expref: 8 pid: 7660 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.121401:0:6715:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000022c8f1a2/0xb72beeaffa1b7078 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf5d expref: 8 pid: 7660 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787579422.121407:0:6715:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa0cebf305500 00000100:00100000:1.0:1787579422.121442:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:1.0:1787579422.121452:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:963d8c17-1326-491b-be60-9002b9296555+8:2360:x1874412591673856:12345-192.168.206.53@tcp:4:lfs.0 00000001:00100000:0.0:1787579422.142608:0:6735:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 963d8c17-1326-491b-be60-9002b9296555 00000100:00100000:1.0:1787579422.143837:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:963d8c17-1326-491b-be60-9002b9296555+9:2360:x1874412591673856:12345-192.168.206.53@tcp:4:lfs.0 Request processed in 22378us (22633us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787579422.143849:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 0 00002000:00100000:1.0:1787579422.143861:0:6715:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffffa0cebf305500 x1874412591673856/t4294967299(0) o4->963d8c17-1326-491b-be60-9002b9296555@192.168.206.53@tcp:663/0 lens 504/448 e 0 to 0 dl 1787579433 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787579422.143871:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0cebf305500 with x1874412591673856 ext(0->12) 00010000:00010000:1.0:1787579422.143888:0:6715:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000022c8f1a2/0xb72beeaffa1b7078 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf5d expref: 9 pid: 7660 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.143906:0:6715:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000022c8f1a2/0xb72beeaffa1b7078 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf5d expref: 9 pid: 7660 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787579422.143914:0:6715:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa0cebf305500 00000100:00100000:2.0:1787579422.148168:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579422.148387:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591673984 00000100:00100000:3.0:1787579422.148400:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591673984 00010000:00010000:3.0:1787579422.148588:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000022c8f1a2/0xb72beeaffa1b7078 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf5d expref: 9 pid: 7660 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579422.148677:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 36 00000100:00100000:3.0:1787579422.148697:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8923a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:963d8c17-1326-491b-be60-9002b9296555+9:2360:x1874412591673984:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787579422.148718:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787579422.148735:0:5852:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787579422.148738:0:5852:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787579421 00002000:00010000:3.0:1787579422.148741:0:5852:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787579421 00002000:00010000:3.0:1787579422.148743:0:5852:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787579421 00010000:00010000:3.0:1787579422.148760:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000022c8f1a2/0xb72beeaffa1b7078 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf5d expref: 9 pid: 7660 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579422.148773:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000022c8f1a2/0xb72beeaffa1b7078 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf5d expref: 9 pid: 7660 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579422.148794:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022c8f1a2/0xb72beeaffa1b7078 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf5d expref: 9 pid: 7660 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579422.148809:0:5852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787579422.148813:0:5852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787579422.148819:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d743d998/0xb72beeaffa1b70c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579422.148828:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d743d998/0xb72beeaffa1b70c5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579422.148917:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579422.149028:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8923a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:963d8c17-1326-491b-be60-9002b9296555+8:2360:x1874412591673984:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 342us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579422.149036:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 36 00010000:00010000:0.0:1787579422.149294:0:6710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d743d998/0xb72beeaffa1b70c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.149304:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d743d998/0xb72beeaffa1b70c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.149391:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d743d998/0xb72beeaffa1b70c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.149400:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d743d998/0xb72beeaffa1b70c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.149407:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d743d998/0xb72beeaffa1b70c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.149431:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8c00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:0.0:1787579422.149435:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d743d998/0xb72beeaffa1b70c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.149453:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d743d998/0xb72beeaffa1b70c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.149465:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d743d998/0xb72beeaffa1b70c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.149472:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d743d998/0xb72beeaffa1b70c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579422.149529:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89238380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+7:2359:x1874412591673728:12345-192.168.206.53@tcp:1:lfs.0 Request processed in 32024us (32286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579422.149537:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 24 00000100:00100000:2.0:1787579422.151792:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579422.152137:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591674240 00000100:00100000:3.0:1787579422.152146:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591674240 00000100:00100000:3.0:1787579422.152184:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:3.0:1787579422.152192:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+19:10318:x1874412591674240:12345-192.168.206.53@tcp:35:lfs.0 00000004:00010000:3.0:1787579422.152243:0:5869:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b70b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf79 expref: 19 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787579422.153765:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1787579422.153809:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1787579422.154485:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1787579422.154541:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b70cc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.154560:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b705c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf4f expref: 23 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.154567:0:5869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b70cc lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.154594:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b705c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf4f expref: 23 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.154604:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b705c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf4f expref: 23 pid: 9530 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579422.154616:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce89239180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5869:1874412616871040:192.168.206.53@tcp:104: 00000100:00100000:2.0:1787579422.154701:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fbd480 going to sleep for 11 seconds 00000100:00100000:2.0:1787579422.157300:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce89239180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5869:1874412616871040:192.168.206.53@tcp:104: 00010000:00010000:2.0:1787579422.157331:0:5869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b70cc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579422.158241:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579422.158323:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591674368 00000100:00100000:3.0:1787579422.158331:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591674368 00010000:00010000:3.0:1787579422.158367:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b705c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf4f expref: 24 pid: 9530 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579422.158405:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 37 00000100:00100000:3.0:1787579422.158416:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89239180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+24:2360:x1874412591674368:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787579422.158431:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579422.158438:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b705c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf4f expref: 24 pid: 9530 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579422.158450:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b705c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf4f expref: 24 pid: 9530 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579422.158471:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b705c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf4f expref: 24 pid: 9530 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579422.158487:0:5851:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456500) 00010000:00010000:3.0:1787579422.158492:0:5851:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b70cc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579422.158501:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b70cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579422.158507:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b70cc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579422.158548:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579422.158602:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89239180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+23:2360:x1874412591674368:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 188us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579422.158609:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 37 00010000:00010000:2.0:1787579422.158668:0:5869:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b70cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.158676:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b70cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787579422.158784:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1787579422.159311:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1787579422.159429:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce8923aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5869:1874412616871168:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787579422.159640:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579422.159674:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fbd240 going to sleep for 11 seconds 00000100:00100000:1.0:1787579422.159696:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616871168 00000100:00100000:1.0:1787579422.159702:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616871168 00000100:00100000:1.0:1787579422.159763:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787579422.159771:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5869:x1874412616871168:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:2.0:1787579422.159779:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787579422.159843:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5869:x1874412616871168:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 73us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579422.159850:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787579422.159997:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce8923aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5869:1874412616871168:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787579422.160597:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1787579422.160650:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebf293800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5869:1874412616871296:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787579422.160684:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579422.160705:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fbd480 going to sleep for 11 seconds 00000100:00100000:3.0:1787579422.160731:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616871296 00000100:00100000:3.0:1787579422.160737:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616871296 00000100:00100000:3.0:1787579422.160768:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787579422.160774:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5869:x1874412616871296:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787579422.160893:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5869:x1874412616871296:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 119us (207us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787579422.160901:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787579422.160976:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebf293800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5869:1874412616871296:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787579422.161029:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1787579422.161064:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b70cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.161071:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b70cc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.161076:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b70cc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.161089:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba319e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579422.161092:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b70cc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.161097:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b70cc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.161110:0:5869:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456500) 00010000:00010000:2.0:1787579422.161112:0:5869:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787579422.161115:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b70cc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.161119:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b70cc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787579422.161261:0:5869:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787579422.161465:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787579422.161475:0:5869:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 358352548172ns, next at 359352546225ns, rc = 0 00000001:00080000:2.0:1787579422.161482:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1787579422.161512:0:5869:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456500) 00010000:00010000:2.0:1787579422.161515:0:5869:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787579422.161521:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b70b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf79 expref: 27 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579422.161623:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+26:10318:x1874412591674240:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 9431us (9836us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1787579422.161640:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 8 00000020:00080000:2.0:1787579422.161644:0:5869:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787579422.167286:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579422.172194:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591674496 00000100:00100000:1.0:1787579422.172207:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591674496 00000100:00100000:1.0:1787579422.172771:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 45 00000100:00100000:1.0:1787579422.172781:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+26:10318:x1874412591674496:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1787579422.172804:0:9530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579422.172825:0:9530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b70d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cf80 expref: -99 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.172876:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b70d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf80 expref: 27 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.172890:0:9530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b70d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf80 expref: 27 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.174052:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456600) 00010000:00010000:1.0:1787579422.174056:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787579422.174060:0:9530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb47c8c00, rc 0) 00000100:00100000:1.0:1787579422.174116:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+27:10318:x1874412591674496:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 1335us (6837us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579422.174124:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 45 00000100:00100000:3.0:1787579422.179486:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579422.179968:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591674752 00000100:00100000:1.0:1787579422.180413:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591674752 00000100:00100000:1.0:1787579422.180534:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00100000:1.0:1787579422.180546:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce9c74b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+27:10318:x1874412591674752:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:1.0:1787579422.180793:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce9c74b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+28:10318:x1874412591674752:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 248us (1314us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1787579422.180802:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00100000:0.0:1787579422.254688:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579422.255028:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591675008 00000100:00100000:2.0:1787579422.255038:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591675008 00000100:00100000:2.0:1787579422.255266:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 46 00000100:00100000:2.0:1787579422.255278:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+28:10328:x1874412591675008:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1787579422.255298:0:5866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579422.255316:0:5866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b70da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cf87 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579422.255415:0:5866:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787579422.255591:0:5866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b70da lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf87 expref: 30 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.255605:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0cea147d400) 00010000:00010000:2.0:1787579422.255608:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787579422.255613:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b70da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf87 expref: 30 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.255625:0:5866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319e00, rc 0) 00000100:00100000:2.0:1787579422.255684:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+29:10328:x1874412591675008:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 409us (1004us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1787579422.255691:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 46 00000100:00100000:3.0:1787579422.258770:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579422.258920:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591675136 00000100:00100000:0.0:1787579422.258967:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591675136 00000100:00100000:0.0:1787579422.259065:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 47 00000100:00100000:0.0:1787579422.259077:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+29:10328:x1874412591675136:12345-192.168.206.53@tcp:34:lfs.0 00010000:00010000:0.0:1787579422.259145:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b70e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259160:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b70e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259172:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b70e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259186:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b70ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259206:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b70ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259214:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b70ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259304:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b70f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259313:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b70f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259321:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b70f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787579422.259357:0:9532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b70f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259369:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b70e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259375:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b70e8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259382:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b70e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259388:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579422.259392:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b70e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259399:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b70e8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259417:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:0.0:1787579422.259420:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579422.259436:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b70e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259443:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b70e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259456:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b70ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259532:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b70ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259538:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b70ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259543:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9c00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579422.259546:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b70ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259552:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b70ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259560:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0ce82cbb800) 00010000:00010000:0.0:1787579422.259562:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579422.259564:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b70ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259569:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b70ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259594:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b70f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259599:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b70f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259604:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b70f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259608:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9a00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579422.259611:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b70f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259616:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b70f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259623:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456600) 00010000:00010000:0.0:1787579422.259626:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579422.259628:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b70f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.259634:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b70f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579422.259710:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+29:10328:x1874412591675136:12345-192.168.206.53@tcp:34:lfs.0 Request processed in 634us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579422.259718:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 47 00000100:00100000:3.0:1787579422.261709:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579422.261765:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591675392 00000100:00100000:2.0:1787579422.261777:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591675392 00000100:00100000:2.0:1787579422.261899:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:2.0:1787579422.261910:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+29:10328:x1874412591675392:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:2.0:1787579422.263661:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+30:10328:x1874412591675392:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 1739us (1945us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787579422.263688:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:2.0:1787579422.300640:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579422.300740:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591675648 00000100:00100000:1.0:1787579422.300749:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591675648 00000100:00100000:1.0:1787579422.300814:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 48 00000100:00100000:1.0:1787579422.300824:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+30:10331:x1874412591675648:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1787579422.300846:0:9530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579422.300867:0:9530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9800/0xb72beeaffa1b70fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cf8e expref: -99 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.300975:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7104 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.300989:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7104 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.301021:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7104 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.301037:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b710b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.301045:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b710b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.301052:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b710b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.301181:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9e00/0xb72beeaffa1b7112 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.301189:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9e00/0xb72beeaffa1b7112 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.301196:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9e00/0xb72beeaffa1b7112 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787579422.301205:0:9530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787579422.301306:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7104 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.301314:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7104 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.301321:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7104 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.301327:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c9c00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579422.301339:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7104 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.301347:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7104 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.301359:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:1.0:1787579422.301362:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579422.301366:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7104 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.301373:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7104 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.301396:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b710b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.301402:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b710b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.301407:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b710b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.301412:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c9a00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579422.301415:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b710b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.301421:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b710b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.301428:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0ce86456300) 00010000:00010000:1.0:1787579422.301431:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579422.301450:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b710b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.301457:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b710b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.301505:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9800/0xb72beeaffa1b70fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf8e expref: 33 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.301520:0:9530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9e00/0xb72beeaffa1b7112 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf8e expref: 32 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.301527:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456600) 00010000:00010000:1.0:1787579422.301530:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787579422.301532:0:9530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb47c9e00, rc 0) 00000100:00100000:1.0:1787579422.301594:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+32:10331:x1874412591675648:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 772us (960us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1787579422.301602:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 48 00000100:00100000:3.0:1787579422.308305:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579422.309612:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591675776 00000100:00100000:2.0:1787579422.309626:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591675776 00000100:00100000:2.0:1787579422.309693:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 49 00000100:00100000:2.0:1787579422.309705:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+32:10331:x1874412591675776:12345-192.168.206.53@tcp:54:lfs.0 00010000:00010000:2.0:1787579422.309768:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7120 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.309787:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7120 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.309800:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7120 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.309827:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7120 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.309834:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7120 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.309854:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7120 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.309860:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba319e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579422.309865:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7120 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.309872:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7120 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.309902:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456600) 00010000:00010000:2.0:1787579422.309905:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787579422.309910:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7120 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.309916:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7120 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579422.310034:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+32:10331:x1874412591675776:12345-192.168.206.53@tcp:54:lfs.0 Request processed in 331us (1743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579422.310042:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 49 00000100:00100000:3.0:1787579422.314029:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579422.317679:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591676032 00000100:00100000:1.0:1787579422.317694:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591676032 00000100:00100000:1.0:1787579422.317764:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:1.0:1787579422.317775:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+32:10331:x1874412591676032:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:1.0:1787579422.318031:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+33:10331:x1874412591676032:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 256us (4009us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1787579422.318048:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:0.0:1787579422.626304:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579422.626421:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591676288 00000100:00100000:3.0:1787579422.626430:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591676288 00000100:00100000:3.0:1787579422.626491:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 50 00000100:00100000:3.0:1787579422.626500:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+33:10363:x1874412591676288:12345-192.168.206.53@tcp:101:cat.0 00010000:00010000:3.0:1787579422.626520:0:9532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579422.626537:0:9532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7127 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cf95 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579422.626640:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b712e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579422.626671:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b712e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579422.626682:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b712e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579422.626694:0:9532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787579422.626829:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7127 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf95 expref: 36 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579422.626847:0:9532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b712e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf95 expref: 35 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579422.626856:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456600) 00010000:00010000:3.0:1787579422.626858:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787579422.626862:0:9532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8152f000, rc 0) 00000100:00100000:3.0:1787579422.626986:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+35:10363:x1874412591676288:12345-192.168.206.53@tcp:101:cat.0 Request processed in 487us (692us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1787579422.626993:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 50 00000100:00100000:3.0:1787579422.631408:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579422.631640:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591676416 00000100:00100000:1.0:1787579422.631650:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591676416 00000100:00100000:1.0:1787579422.631718:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 2 00000100:00100000:1.0:1787579422.631729:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+35:2359:x1874412591676416:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787579422.631757:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787579422.631780:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b712e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf95 expref: 35 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.631799:0:8477:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456600) 00010000:00010000:1.0:1787579422.631803:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787579422.631857:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+34:2359:x1874412591676416:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 130us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579422.631864:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 2 00000100:00100000:1.0:1787579422.637329:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579422.637407:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591676672 00000100:00100000:0.0:1787579422.637416:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591676672 00000100:00100000:0.0:1787579422.637474:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:0.0:1787579422.637482:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+34:10363:x1874412591676672:12345-192.168.206.53@tcp:35:cat.0 00000100:00100000:0.0:1787579422.637711:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+35:10363:x1874412591676672:12345-192.168.206.53@tcp:35:cat.0 Request processed in 221us (382us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1787579422.637720:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:0.0:1787579422.690220:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579422.691997:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591676928 00000100:00100000:1.0:1787579422.692009:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591676928 00000100:00100000:1.0:1787579422.692131:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 51 00000100:00100000:1.0:1787579422.692142:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+35:10369:x1874412591676928:12345-192.168.206.53@tcp:101:dd.0 00010000:00010000:1.0:1787579422.692164:0:9530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579422.692167:0:9530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787579422.692192:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7094 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf6b expref: 35 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.692210:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:1.0:1787579422.692215:0:9530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787579422.692227:0:9530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b713c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cf9c expref: -99 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.692327:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7143 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.692355:0:9530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9e00/0xb72beeaffa1b7112 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf8e expref: 35 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.692364:0:9530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7143 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.692397:0:9530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9e00/0xb72beeaffa1b7112 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf8e expref: 35 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.692409:0:9530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9e00/0xb72beeaffa1b7112 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf8e expref: 35 pid: 9530 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579422.692422:0:9530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce812a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9530:1874412616871424:192.168.206.53@tcp:104: 00000100:00100000:1.0:1787579422.692659:0:9530:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce87c69840 going to sleep for 11 seconds 00000100:00100000:3.0:1787579422.697154:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579422.697336:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591677056 00000100:00100000:0.0:1787579422.697345:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591677056 00000100:00100000:1.0:1787579422.697363:0:9530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce812a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9530:1874412616871424:192.168.206.53@tcp:104: 00010000:00010000:0.0:1787579422.697378:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9e00/0xb72beeaffa1b7112 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf8e expref: 36 pid: 9530 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.697384:0:9530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7143 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579422.697419:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 38 00000100:00100000:0.0:1787579422.697428:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce90ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+36:2360:x1874412591677056:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579422.697457:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579422.697464:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9e00/0xb72beeaffa1b7112 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf8e expref: 36 pid: 9530 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.697477:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9e00/0xb72beeaffa1b7112 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf8e expref: 36 pid: 9530 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.697499:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9e00/0xb72beeaffa1b7112 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf8e expref: 36 pid: 9530 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.697514:0:5850:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456600) 00010000:00010000:0.0:1787579422.697518:0:5850:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7143 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.697543:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7143 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.697566:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7143 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.697596:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579422.697661:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce90ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+35:2360:x1874412591677056:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 232us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579422.697668:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 38 00010000:00010000:1.0:1787579422.698007:0:9530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7143 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.698016:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7143 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787579422.698034:0:9530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787579422.698229:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b713c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf9c expref: 36 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.698258:0:9530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7143 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf9c expref: 35 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579422.698266:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456600) 00010000:00010000:1.0:1787579422.698269:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787579422.698271:0:9530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb47c9c00, rc 0) 00000100:00100000:1.0:1787579422.698311:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+35:10369:x1874412591676928:12345-192.168.206.53@tcp:101:dd.0 Request processed in 6171us (8101us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1787579422.698319:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 51 00000100:00100000:3.0:1787579422.702222:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579422.702372:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591677312 00000100:00100000:2.0:1787579422.702380:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591677312 00000100:00100000:2.0:1787579422.702440:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 52 00000100:00100000:2.0:1787579422.702513:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+35:10369:x1874412591677312:12345-192.168.206.53@tcp:36:dd.0 00010000:00010000:2.0:1787579422.703179:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7151 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.703197:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7151 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579422.703208:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7151 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787579422.704074:0:5866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1787579422.704106:0:5866:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a9aadd7 reply state 000000003e05d77d transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7151 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579422.704116:0:5866:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787579422.704273:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+38:10369:x1874412591677312:12345-192.168.206.53@tcp:36:dd.0 Request processed in 1821us (2058us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1787579422.704282:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 52 00000020:00080000:2.0:1787579422.704288:0:5866:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787579422.713429:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7151 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.713445:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7151 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.713520:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7151 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.713526:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579422.713531:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7151 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.713539:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7151 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.713628:0:3305:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456600) 00010000:00010000:0.0:1787579422.713632:0:3305:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579422.713637:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7151 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579422.713661:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7151 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579423.043631:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579423.043723:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591677440 00000100:00100000:0.0:1787579423.043733:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591677440 00000100:00100000:0.0:1787579423.043821:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 53 00000100:00100000:0.0:1787579423.043833:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+37:10383:x1874412591677440:12345-192.168.206.53@tcp:101:stat.0 00010000:00010000:0.0:1787579423.043866:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579423.043888:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7158 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cfa3 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.043989:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b715f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.044004:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b715f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.044018:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b715f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.044032:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8a00/0xb72beeaffa1b7166 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.044039:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8a00/0xb72beeaffa1b7166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.044046:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8a00/0xb72beeaffa1b7166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.044129:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8600/0xb72beeaffa1b716d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.044152:0:5867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7143 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf9c expref: 38 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.044161:0:5867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8600/0xb72beeaffa1b716d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.044193:0:5867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7143 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf9c expref: 38 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.044207:0:5867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7143 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf9c expref: 38 pid: 9530 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579423.044220:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebf307b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5867:1874412616871552:192.168.206.53@tcp:104: 00000100:00100000:0.0:1787579423.044312:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb448ce40 going to sleep for 11 seconds 00000100:00080000:2.0:1787579423.044662:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787579423.048502:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579423.048568:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591677696 00000100:00100000:1.0:1787579423.048577:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591677696 00000100:00100000:0.0:1787579423.048662:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebf307b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5867:1874412616871552:192.168.206.53@tcp:104: 00000100:00100000:1.0:1787579423.048688:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 13 00010000:00010000:0.0:1787579423.048692:0:5867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8600/0xb72beeaffa1b716d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579423.048701:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+39:5601:x1874412591677696:12345-192.168.206.53@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787579423.049055:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+40:5601:x1874412591677696:12345-192.168.206.53@tcp:35:ldlm_bl.0 Request processed in 357us (561us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1787579423.049063:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 13 00000100:00100000:1.0:1787579423.055054:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579423.055108:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591677824 00000100:00100000:3.0:1787579423.055118:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591677824 00010000:00010000:3.0:1787579423.055155:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7143 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf9c expref: 40 pid: 9530 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579423.055214:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 39 00000100:00100000:3.0:1787579423.055224:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+40:2361:x1874412591677824:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787579423.055237:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579423.055244:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7143 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf9c expref: 40 pid: 9530 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.055258:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7143 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf9c expref: 40 pid: 9530 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.055279:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7143 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf9c expref: 40 pid: 9530 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.055294:0:8477:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456600) 00010000:00010000:3.0:1787579423.055299:0:8477:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8600/0xb72beeaffa1b716d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.055308:0:8477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8600/0xb72beeaffa1b716d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.055315:0:8477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8600/0xb72beeaffa1b716d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.055348:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579423.055401:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+39:2361:x1874412591677824:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 179us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579423.055410:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 39 00010000:00010000:1.0:1787579423.055428:0:5867:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8600/0xb72beeaffa1b716d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.055439:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8600/0xb72beeaffa1b716d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787579423.055481:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787579423.055485:0:5867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787579423.055524:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8600/0xb72beeaffa1b716d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.055545:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8600/0xb72beeaffa1b716d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.055554:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b715f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.055560:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b715f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.055566:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b715f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.055572:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579423.055575:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b715f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.055582:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b715f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.055590:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:1.0:1787579423.055593:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579423.055596:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b715f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.055602:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b715f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.055613:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8a00/0xb72beeaffa1b7166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.055619:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8a00/0xb72beeaffa1b7166 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.055632:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8a00/0xb72beeaffa1b7166 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.055637:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8a00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579423.055640:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8a00/0xb72beeaffa1b7166 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.055647:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8a00/0xb72beeaffa1b7166 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.055655:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0ce82cbb800) 00010000:00010000:1.0:1787579423.055658:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579423.055661:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8a00/0xb72beeaffa1b7166 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.055666:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8a00/0xb72beeaffa1b7166 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.055701:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7158 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfa3 expref: 39 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.055791:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8600/0xb72beeaffa1b716d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfa3 expref: 38 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.055799:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456600) 00010000:00010000:1.0:1787579423.055802:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787579423.055804:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c8600, rc 0) 00000100:00100000:1.0:1787579423.055838:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+38:10383:x1874412591677440:12345-192.168.206.53@tcp:101:stat.0 Request processed in 12007us (12215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579423.055855:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 53 00010000:00010000:3.0:1787579423.136872:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579423.180848:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579423.182798:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591678080 00000100:00100000:1.0:1787579423.182811:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591678080 00000100:00100000:1.0:1787579423.182877:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 54 00000100:00100000:1.0:1787579423.182887:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+38:10389:x1874412591678080:12345-192.168.206.53@tcp:36:truncate.0 00010000:00010000:1.0:1787579423.183620:0:9530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787579423.183650:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8600/0xb72beeaffa1b716d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfa3 expref: 38 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.183669:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456600) 00010000:00010000:1.0:1787579423.183674:0:9530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787579423.184071:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8800/0xb72beeaffa1b7174 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.184084:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8800/0xb72beeaffa1b7174 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.184094:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8800/0xb72beeaffa1b7174 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787579423.184139:0:9530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1787579423.184160:0:9530:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000065c95544 reply state 000000009f1281ec transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8800/0xb72beeaffa1b7174 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579423.184168:0:9530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787579423.184283:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+40:10389:x1874412591678080:12345-192.168.206.53@tcp:36:truncate.0 Request processed in 1395us (3441us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1787579423.184291:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 54 00000020:00080000:1.0:1787579423.184303:0:9530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787579423.193363:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8800/0xb72beeaffa1b7174 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.193382:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8800/0xb72beeaffa1b7174 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.193390:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8800/0xb72beeaffa1b7174 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.193396:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c8800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579423.193402:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8800/0xb72beeaffa1b7174 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.193410:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8800/0xb72beeaffa1b7174 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.193427:0:3306:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456600) 00010000:00010000:1.0:1787579423.193430:0:3306:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579423.193434:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8800/0xb72beeaffa1b7174 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.193440:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8800/0xb72beeaffa1b7174 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579423.385079:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579423.385224:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591678208 00000100:00100000:2.0:1787579423.385235:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591678208 00000100:00100000:2.0:1787579423.385290:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 55 00000100:00100000:2.0:1787579423.385300:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+39:10403:x1874412591678208:12345-192.168.206.53@tcp:101:stat.0 00010000:00010000:2.0:1787579423.385323:0:5866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579423.385342:0:5866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b717b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cfaa expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.385401:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7182 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.385414:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7182 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.385424:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7182 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.385437:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b7189 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.385444:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b7189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.385451:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b7189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.385617:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7190 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.385626:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7190 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.385633:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7190 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579423.385662:0:5866:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1787579423.385666:0:5866:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787579423.385686:0:5866:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7190 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.385697:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7190 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.385704:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7182 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.385711:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7182 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.385717:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7182 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.385724:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318400 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579423.385728:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7182 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.385735:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7182 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.385753:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:2.0:1787579423.385756:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579423.385760:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7182 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.385766:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7182 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.385779:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b7189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.385786:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b7189 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.385792:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b7189 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.385796:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318c00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579423.385799:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b7189 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.385805:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b7189 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.385812:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0cea147dc00) 00010000:00010000:2.0:1787579423.385814:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579423.385817:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b7189 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.385823:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b7189 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.385863:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b717b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfaa expref: 41 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.385875:0:5866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7190 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfaa expref: 40 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.385882:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456600) 00010000:00010000:2.0:1787579423.385884:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787579423.385887:0:5866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba318e00, rc 0) 00000100:00100000:2.0:1787579423.386387:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+40:10403:x1874412591678208:12345-192.168.206.53@tcp:101:stat.0 Request processed in 1086us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579423.386396:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 55 00000100:00100000:2.0:1787579423.514297:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579423.514580:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591678464 00000100:00100000:1.0:1787579423.514590:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591678464 00000100:00100000:1.0:1787579423.514691:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 56 00000100:00100000:1.0:1787579423.514712:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+40:10413:x1874412591678464:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1787579423.514731:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579423.514762:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8800/0xb72beeaffa1b7197 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cfb1 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787579423.514890:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787579423.515057:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8800/0xb72beeaffa1b7197 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfb1 expref: 42 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.515071:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0cea147d400) 00010000:00010000:1.0:1787579423.515074:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787579423.515079:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8800/0xb72beeaffa1b7197 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfb1 expref: 42 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.515092:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb47c8800, rc 0) 00000100:00100000:1.0:1787579423.515153:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+41:10413:x1874412591678464:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 454us (865us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1787579423.515160:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 56 00000100:00100000:1.0:1787579423.524166:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579423.524657:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591678720 00000100:00100000:2.0:1787579423.524666:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591678720 00000100:00100000:2.0:1787579423.526114:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 14 00000100:00100000:2.0:1787579423.526131:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+41:10413:x1874412591678720:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:2.0:1787579423.526389:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+42:10413:x1874412591678720:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 263us (2231us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787579423.526397:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 14 00000100:00100000:2.0:1787579423.593602:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579423.594002:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591678976 00000100:00100000:1.0:1787579423.594013:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591678976 00000100:00100000:1.0:1787579423.594111:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 57 00000100:00100000:1.0:1787579423.594121:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+42:10419:x1874412591678976:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:1.0:1787579423.594141:0:9530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579423.594160:0:9530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8a00/0xb72beeaffa1b71a5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cfb8 expref: -99 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.594262:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b71ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.594275:0:9530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7190 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfaa expref: 43 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.594295:0:9530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b71ac lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.594322:0:9530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7190 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfaa expref: 43 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579423.594334:0:9530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7190 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfaa expref: 43 pid: 5866 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579423.594346:0:9530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce812ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9530:1874412616871680:192.168.206.53@tcp:104: 00000100:00100000:1.0:1787579423.594440:0:9530:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce87c69780 going to sleep for 11 seconds 00000100:00100000:1.0:1787579423.608996:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579423.609104:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591679104 00000100:00100000:0.0:1787579423.609113:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591679104 00010000:00010000:0.0:1787579423.609151:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7190 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfaa expref: 44 pid: 5866 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579423.609194:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 40 00000100:00100000:0.0:1787579423.609205:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+44:2359:x1874412591679104:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579423.609230:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579423.609248:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7190 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfaa expref: 44 pid: 5866 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.609260:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7190 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfaa expref: 44 pid: 5866 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.609281:0:5850:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456600) 00010000:00010000:0.0:1787579423.609286:0:5850:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b71ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.609294:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b71ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.609302:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b71ac lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.609321:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579423.609386:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+44:2359:x1874412591679104:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 183us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579423.609393:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 40 00010000:00010000:3.0:1787579423.611032:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7190 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfaa expref: 43 pid: 5866 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579423.611052:0:9530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce812ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9530:1874412616871680:192.168.206.53@tcp:104: 00010000:00010000:3.0:1787579423.611073:0:9530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b71ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.611082:0:9530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b71ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.611088:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b71ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579423.611106:0:9530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1787579423.612039:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8a00/0xb72beeaffa1b71a5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfb8 expref: 44 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.612058:0:9530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b71ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfb8 expref: 43 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.612068:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456600) 00010000:00010000:3.0:1787579423.612070:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787579423.612074:0:9530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb47c8600, rc 0) 00000100:00100000:3.0:1787579423.612123:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+43:10419:x1874412591678976:12345-192.168.206.53@tcp:101:bash.0 Request processed in 18004us (18530us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1787579423.612131:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 57 00000100:00100000:1.0:1787579423.615991:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579423.616099:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591679360 00000100:00100000:2.0:1787579423.616108:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591679360 00000100:00100000:2.0:1787579423.616164:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 58 00000100:00100000:2.0:1787579423.616174:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+43:10419:x1874412591679360:12345-192.168.206.53@tcp:36:bash.0 00010000:00010000:2.0:1787579423.616451:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b71ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.616467:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b71ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.616478:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b71ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787579423.616976:0:5866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1787579423.617004:0:5866:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ff7a38c reply state 00000000afb5ace2 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b71ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579423.617014:0:5866:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787579423.617105:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+46:10419:x1874412591679360:12345-192.168.206.53@tcp:36:bash.0 Request processed in 930us (1122us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787579423.617113:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 58 00000020:00080000:2.0:1787579423.617117:0:5866:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787579423.622728:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b71ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.622745:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b71ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.622752:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b71ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.622759:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318c00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579423.622764:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b71ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.622787:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b71ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.622805:0:3305:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456600) 00010000:00010000:0.0:1787579423.622808:0:3305:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579423.622813:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b71ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.622819:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b71ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579423.634447:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579423.635204:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591679488 00000100:00100000:0.0:1787579423.635214:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591679488 00000100:00100000:0.0:1787579423.635333:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 59 00000100:00100000:0.0:1787579423.635345:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+45:10419:x1874412591679488:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:0.0:1787579423.635368:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579423.635388:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b71c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cfbf expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.635495:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b71c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.635510:0:5867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b71ac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfb8 expref: 46 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.635519:0:5867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b71c8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.635553:0:5867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b71ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfb8 expref: 46 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.635574:0:5867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b71ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfb8 expref: 46 pid: 9530 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579423.635589:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebf307b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5867:1874412616871808:192.168.206.53@tcp:104: 00000100:00100000:0.0:1787579423.635665:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb448ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1787579423.639539:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579423.639693:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591679616 00000100:00100000:3.0:1787579423.639722:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591679616 00010000:00010000:3.0:1787579423.639759:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b71ac lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfb8 expref: 47 pid: 9530 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579423.639840:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 41 00000100:00100000:3.0:1787579423.639851:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+47:2360:x1874412591679616:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787579423.639880:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579423.639887:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b71ac lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfb8 expref: 47 pid: 9530 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.639900:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b71ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfb8 expref: 47 pid: 9530 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.639921:0:8477:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456600) 00010000:00010000:3.0:1787579423.640452:0:8477:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b71c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.640465:0:8477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b71c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.640473:0:8477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b71c8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.640493:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579423.640541:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+47:2360:x1874412591679616:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 692us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579423.640550:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 41 00010000:00010000:0.0:1787579423.641481:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b71ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfb8 expref: 46 pid: 9530 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579423.641525:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebf307b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5867:1874412616871808:192.168.206.53@tcp:104: 00010000:00010000:0.0:1787579423.641567:0:5867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b71c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.641576:0:5867:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b71c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.641581:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b71c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579423.642215:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787579423.642221:0:5867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787579423.642283:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b71c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.642401:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b71c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfbf expref: 46 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.642416:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b71c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfbf expref: 45 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.642433:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456600) 00010000:00010000:0.0:1787579423.642436:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787579423.642439:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c9000, rc 0) 00000100:00100000:0.0:1787579423.642563:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+45:10419:x1874412591679488:12345-192.168.206.53@tcp:101:bash.0 Request processed in 7220us (8128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579423.642571:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 59 00000100:00100000:1.0:1787579423.659664:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579423.659797:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591679872 00000100:00100000:0.0:1787579423.659806:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591679872 00000100:00100000:0.0:1787579423.659865:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 15 00000100:00100000:0.0:1787579423.659875:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce9c748c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+45:10419:x1874412591679872:12345-192.168.206.53@tcp:35:bash.0 00000100:00100000:0.0:1787579423.660706:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce9c748c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+46:10419:x1874412591679872:12345-192.168.206.53@tcp:35:bash.0 Request processed in 824us (1042us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1787579423.660715:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 15 00000100:00100000:2.0:1787579423.767846:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579423.767984:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591680128 00000100:00100000:3.0:1787579423.767995:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591680128 00000100:00100000:2.0:1787579423.768184:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 60 00000100:00100000:2.0:1787579423.768196:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+46:10429:x1874412591680128:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1787579423.768218:0:9530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579423.768238:0:9530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b71cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cfc6 expref: -99 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579423.768356:0:9530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787579423.768477:0:9530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b71cf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfc6 expref: 48 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.768509:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0cea147d400) 00010000:00010000:2.0:1787579423.768512:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787579423.768517:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b71cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfc6 expref: 48 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.768530:0:9530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319e00, rc 0) 00000100:00100000:2.0:1787579423.768701:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+47:10429:x1874412591680128:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 507us (864us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1787579423.768709:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 60 00000100:00100000:2.0:1787579423.774113:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579423.774162:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591680256 00000100:00100000:3.0:1787579423.774171:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591680256 00000100:00100000:3.0:1787579423.774230:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 61 00000100:00100000:3.0:1787579423.774241:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+47:10429:x1874412591680256:12345-192.168.206.53@tcp:34:lfs.0 00010000:00010000:3.0:1787579423.774310:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b71dd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774325:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b71dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774336:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b71dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774350:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b71e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774358:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b71e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774365:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b71e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774454:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b71eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774463:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b71eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774470:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b71eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787579423.774513:0:9532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b71eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774539:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b71dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774545:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b71dd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774551:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b71dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774556:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8152e200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579423.774560:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b71dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774566:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b71dd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774578:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:3.0:1787579423.774581:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579423.774585:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b71dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774590:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b71dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774601:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b71e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774606:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b71e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774611:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b71e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774622:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8152ec00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579423.774625:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b71e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774631:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b71e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774640:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0ce84d55400) 00010000:00010000:3.0:1787579423.774642:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579423.774644:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b71e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774650:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b71e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774664:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b71eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774671:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b71eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774677:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b71eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774682:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8152f000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579423.774684:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b71eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774689:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b71eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774719:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456600) 00010000:00010000:3.0:1787579423.774721:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579423.774724:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b71eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579423.774730:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b71eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579423.774800:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+47:10429:x1874412591680256:12345-192.168.206.53@tcp:34:lfs.0 Request processed in 561us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579423.774808:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 61 00000100:00100000:1.0:1787579423.777283:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579423.778213:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591680512 00000100:00100000:2.0:1787579423.778223:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591680512 00000100:00100000:2.0:1787579423.778279:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00100000:2.0:1787579423.778288:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+47:10429:x1874412591680512:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:2.0:1787579423.779160:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+48:10429:x1874412591680512:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 869us (1880us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787579423.779169:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00100000:2.0:1787579423.835970:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579423.836232:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591680768 00000100:00100000:0.0:1787579423.836241:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591680768 00000100:00100000:0.0:1787579423.836316:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 62 00000100:00100000:0.0:1787579423.836327:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+48:10432:x1874412591680768:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1787579423.836349:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579423.836369:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b71f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cfcd expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.836440:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b71f9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.836454:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b71f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.836478:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b71f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.836494:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7200 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.836501:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7200 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.836508:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7200 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.836627:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7207 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.836636:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.836643:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579423.836652:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787579423.837426:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b71f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.837436:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b71f9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.837443:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b71f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.837449:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8400 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579423.837460:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b71f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.837468:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b71f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.837481:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:0.0:1787579423.837483:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579423.837488:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b71f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.837494:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b71f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.837507:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7200 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.837514:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7200 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.837519:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7200 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.837524:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579423.837527:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7200 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.837532:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7200 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.837539:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0ce82cbbb00) 00010000:00010000:0.0:1787579423.837541:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579423.837550:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7200 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.837556:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7200 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.837600:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b71f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfcd expref: 51 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.837614:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7207 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfcd expref: 50 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.837621:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456600) 00010000:00010000:0.0:1787579423.837624:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787579423.837626:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c8e00, rc 0) 00000100:00100000:0.0:1787579423.837681:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+50:10432:x1874412591680768:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 1356us (1771us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1787579423.837689:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 62 00000100:00100000:1.0:1787579423.846920:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579423.846993:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579423.847001:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591680896 00000100:00100000:0.0:1787579423.847010:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591680896 00000100:00100000:2.0:1787579423.847067:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591681024 00000100:00100000:2.0:1787579423.847071:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591681024 00000100:00100000:0.0:1787579423.847072:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 3 00000100:00100000:0.0:1787579423.847081:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+51:2359:x1874412591680896:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579423.847095:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787579423.847108:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 63 00000100:00100000:2.0:1787579423.847115:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+51:10432:x1874412591681024:12345-192.168.206.53@tcp:54:lfs.0 00010000:00010000:0.0:1787579423.847117:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7207 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfcd expref: 51 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579423.847131:0:5850:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456600) 00010000:00010000:0.0:1787579423.847136:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787579423.847165:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7215 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.847187:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7215 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.847196:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7215 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.847222:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7215 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.847229:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7215 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.847235:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7215 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.847241:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579423.847245:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7215 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.847263:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7215 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.847271:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456600) 00010000:00010000:2.0:1787579423.847274:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787579423.847277:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7215 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579423.847282:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7215 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579423.847311:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+50:10432:x1874412591681024:12345-192.168.206.53@tcp:54:lfs.0 Request processed in 197us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579423.847311:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+50:2359:x1874412591680896:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 230us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579423.847319:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 3 00000100:00100000:2.0:1787579423.847321:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 63 00000100:00100000:1.0:1787579423.858186:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579423.860651:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591681280 00000100:00100000:0.0:1787579423.860665:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591681280 00000100:00100000:0.0:1787579423.860741:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 17 00000100:00100000:0.0:1787579423.860752:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec17c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+49:10432:x1874412591681280:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:0.0:1787579423.861017:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec17c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+50:10432:x1874412591681280:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 265us (2837us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1787579423.861025:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 17 00000100:00100000:2.0:1787579424.007249:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579424.007534:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591681536 00000100:00100000:1.0:1787579424.007544:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591681536 00000100:00100000:1.0:1787579424.007600:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 64 00000100:00100000:1.0:1787579424.007610:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+50:10450:x1874412591681536:12345-192.168.206.53@tcp:101:cat.0 00010000:00010000:1.0:1787579424.007633:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579424.007653:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9200/0xb72beeaffa1b721c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cfd4 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.007759:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8e00/0xb72beeaffa1b7223 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.007772:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8e00/0xb72beeaffa1b7223 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.007782:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8e00/0xb72beeaffa1b7223 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787579424.007793:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787579424.007914:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9200/0xb72beeaffa1b721c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfd4 expref: 53 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.007967:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8e00/0xb72beeaffa1b7223 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfd4 expref: 52 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.007975:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456600) 00010000:00010000:1.0:1787579424.007978:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787579424.007981:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb47c8e00, rc 0) 00000100:00100000:1.0:1787579424.008037:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+52:10450:x1874412591681536:12345-192.168.206.53@tcp:101:cat.0 Request processed in 429us (799us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1787579424.008045:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 64 00000100:00100000:1.0:1787579424.039114:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579424.039219:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591681664 00000100:00100000:0.0:1787579424.039228:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591681664 00000100:00100000:0.0:1787579424.039288:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 65 00000100:00100000:0.0:1787579424.039309:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+52:10451:x1874412591681664:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1787579424.039338:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579424.039362:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7231 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cfdb expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579424.039430:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7238 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579424.039446:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7238 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579424.039460:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7238 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579424.039522:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1787579424.039528:0:5867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787579424.039563:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7238 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579424.039766:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7231 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfdb expref: 54 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579424.039789:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7238 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfdb expref: 53 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579424.039797:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:0.0:1787579424.039800:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787579424.039804:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c9600, rc 0) 00000100:00100000:0.0:1787579424.039867:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+53:10451:x1874412591681664:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 570us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579424.039874:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 65 00000100:00100000:2.0:1787579424.049695:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579424.054027:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591682048 00000100:00100000:0.0:1787579424.054041:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591682048 00000100:00100000:0.0:1787579424.054112:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 18 00000100:00100000:0.0:1787579424.054123:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+53:10451:x1874412591682048:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:0.0:1787579424.054456:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+54:10451:x1874412591682048:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 334us (4768us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1787579424.054464:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 18 00000100:00100000:1.0:1787579424.061778:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579424.065048:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591682176 00000100:00100000:0.0:1787579424.065062:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591682176 00000100:00100000:0.0:1787579424.065134:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 4 00000100:00100000:0.0:1787579424.065144:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4694e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:963d8c17-1326-491b-be60-9002b9296555+54:10451:x1874412591682176:12345-192.168.206.53@tcp:103:lfs.0 00010000:00010000:0.0:1787579424.065159:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787579424.065196:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b71c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfbf expref: 54 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579424.065217:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8e00/0xb72beeaffa1b7223 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfd4 expref: 53 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579424.065230:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b70d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf80 expref: 52 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579424.065246:0:5852:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce86456600) 00010000:00010000:0.0:1787579424.065256:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579424.065336:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4694e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:963d8c17-1326-491b-be60-9002b9296555+51:10451:x1874412591682176:12345-192.168.206.53@tcp:103:lfs.0 Request processed in 192us (3567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579424.065343:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 4 00000100:00100000:1.0:1787579424.072333:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579424.072477:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591682304 00000100:00100000:3.0:1787579424.072487:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591682304 00000100:00100000:3.0:1787579424.072540:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 66 00000100:00100000:3.0:1787579424.072550:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+51:10451:x1874412591682304:12345-192.168.206.53@tcp:58:lfs.0 00010000:00010000:3.0:1787579424.072660:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b723f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.072674:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b723f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.072685:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b723f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787579424.073054:0:9532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787579424.073264:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1787579424.074144:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1787579424.074252:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+51:10451:x1874412591682304:12345-192.168.206.53@tcp:58:lfs.0 Request processed in 1700us (1924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579424.075488:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 66 00000100:00100000:2.0:1787579424.109234:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579424.109657:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591682432 00000100:00100000:1.0:1787579424.109666:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591682432 00000100:00100000:1.0:1787579424.109827:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 67 00000100:00100000:1.0:1787579424.109850:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+51:10453:x1874412591682432:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1787579424.110290:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579424.110373:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b7246 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cfe2 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.110435:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9e00/0xb72beeaffa1b724d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.110447:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9e00/0xb72beeaffa1b724d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.110458:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9e00/0xb72beeaffa1b724d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.110471:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9800/0xb72beeaffa1b7254 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.110478:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9800/0xb72beeaffa1b7254 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.110484:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9800/0xb72beeaffa1b7254 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.110573:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b725b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.110581:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b725b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.110588:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b725b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787579424.110630:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787579424.110634:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787579424.110653:0:5868:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b725b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.110664:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b725b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.110673:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9e00/0xb72beeaffa1b724d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.110679:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9e00/0xb72beeaffa1b724d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.110685:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9e00/0xb72beeaffa1b724d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.110690:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c9e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579424.110759:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9e00/0xb72beeaffa1b724d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.110768:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9e00/0xb72beeaffa1b724d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.110780:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:1.0:1787579424.110782:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579424.110787:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9e00/0xb72beeaffa1b724d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.110793:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9e00/0xb72beeaffa1b724d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.110816:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9800/0xb72beeaffa1b7254 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.110822:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9800/0xb72beeaffa1b7254 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.110829:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9800/0xb72beeaffa1b7254 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.110834:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c9800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579424.110837:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9800/0xb72beeaffa1b7254 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.110842:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9800/0xb72beeaffa1b7254 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.110850:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0ce86456300) 00010000:00010000:1.0:1787579424.110852:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579424.110855:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9800/0xb72beeaffa1b7254 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.110860:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9800/0xb72beeaffa1b7254 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.111070:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b7246 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfe2 expref: 53 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.111085:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b725b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfe2 expref: 52 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579424.111103:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce84d55400) 00010000:00010000:1.0:1787579424.111105:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787579424.111108:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb47c8200, rc 0) 00000100:00100000:1.0:1787579424.111172:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+52:10453:x1874412591682432:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 1323us (1946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579424.111179:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 67 00010000:00010000:3.0:1787579424.160765:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787579424.865147:0:11712:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787579424.865156:0:11712:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787579424.865206:0:11712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787579424.865212:0:11712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787579424.865343:0:11712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebf293b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11712:1874412616871936:192.168.206.53@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787579424.865435:0:11712:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84d2b000 going to sleep for 11 seconds 00000100:00100000:3.0:1787579424.872229:0:11712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebf293b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11712:1874412616871936:192.168.206.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787579424.890963:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000040:00080000:1.0:1787579424.891200:0:12025:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787579424.891205:0:12025:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1787579424.891251:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591682560 00000040:00080000:1.0:1787579424.891260:0:12025:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000100:00100000:2.0:1787579424.891261:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591682560 00000100:00100000:2.0:1787579424.891307:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 1 00000100:00100000:2.0:1787579424.891317:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:963d8c17-1326-491b-be60-9002b9296555+52:10464:x1874412591682560:12345-192.168.206.53@tcp:900:lhsmtool_posix.0 00000040:00080000:1.0:1787579424.891487:0:12025:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787579424.891856:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:963d8c17-1326-491b-be60-9002b9296555+52:10464:x1874412591682560:12345-192.168.206.53@tcp:900:lhsmtool_posix.0 Request processed in 538us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579424.891865:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 1 00000100:00100000:3.0:1787579424.901444:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579424.901579:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591682688 00000100:00100000:0.0:1787579424.901589:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591682688 00000100:00100000:0.0:1787579424.901648:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 68 00000100:00100000:0.0:1787579424.901658:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+52:10464:x1874412591682688:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787579424.901778:0:9530:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787579424.901874:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+52:10464:x1874412591682688:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 Request processed in 217us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579424.901882:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 68 00000100:00100000:0.0:1787579424.908550:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579424.908798:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591682816 00000100:00100000:3.0:1787579424.908807:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591682816 00000100:00100000:3.0:1787579424.908866:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 69 00000100:00100000:3.0:1787579424.908877:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+52:10464:x1874412591682816:12345-192.168.206.53@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787579424.908975:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b7262 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.908991:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b7262 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.909004:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b7262 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.909020:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7269 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.909027:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7269 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.909033:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7269 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.909092:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7270 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.909100:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.909121:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579424.909158:0:9532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787579424.909162:0:9532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787579424.909174:0:9532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.909185:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b7262 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.909191:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b7262 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.909198:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b7262 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.909204:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8152ec00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579424.909208:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b7262 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.909215:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b7262 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.909227:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0ce84d55300) 00010000:00010000:3.0:1787579424.909230:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579424.909234:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b7262 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.909240:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b7262 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.909267:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7269 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.909396:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7269 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.909402:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7269 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.909407:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8152e200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579424.909411:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7269 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.909417:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7269 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.909425:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffffa0ce84d55b00) 00010000:00010000:3.0:1787579424.909428:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579424.909431:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7269 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.909437:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7269 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.909449:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.909455:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7270 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.909459:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7270 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.909471:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8152ea00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579424.909474:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7270 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.909479:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7270 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.909487:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce84d55400) 00010000:00010000:3.0:1787579424.909490:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579424.909492:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7270 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.909499:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7270 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579424.909563:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+52:10464:x1874412591682816:12345-192.168.206.53@tcp:34:lhsmtool_posix.0 Request processed in 687us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579424.909571:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 69 00000100:00100000:0.0:1787579424.913609:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579424.913678:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591683072 00000100:00100000:3.0:1787579424.913696:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591683072 00000100:00100000:3.0:1787579424.913748:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 70 00000100:00100000:3.0:1787579424.913758:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+52:10464:x1874412591683072:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787579424.913777:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579424.913797:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b7277 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cfe9 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.913900:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b727e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.913956:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b727e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.913968:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b727e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579424.913980:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787579424.914080:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b727e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.914087:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b727e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.914094:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b727e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.914099:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce813fde00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579424.914103:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b727e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.914110:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b727e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.914121:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce84d55400) 00010000:00010000:3.0:1787579424.914124:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787579424.914128:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b727e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.914135:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b727e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.914172:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b7277 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfe9 expref: 54 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.914198:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0ce84d55300) 00010000:00010000:3.0:1787579424.914200:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787579424.914205:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b7277 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfe9 expref: 54 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.914215:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce813fca00, rc 0) 00000100:00100000:3.0:1787579424.914265:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+53:10464:x1874412591683072:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 509us (662us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1787579424.914283:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 70 00000100:00100000:0.0:1787579424.923763:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579424.923794:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591683200 00000100:00100000:0.0:1787579424.923811:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591683200 00000100:00100000:0.0:1787579424.923857:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 71 00000100:00100000:0.0:1787579424.923867:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+53:10464:x1874412591683200:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787579424.923896:0:5866:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787579424.924018:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+53:10464:x1874412591683200:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 Request processed in 151us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579424.924027:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 71 00000100:00100000:3.0:1787579424.941774:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579424.945138:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591683456 00000100:00100000:0.0:1787579424.945152:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591683456 00000100:00100000:0.0:1787579424.945205:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 72 00000100:00100000:0.0:1787579424.945214:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+53:10464:x1874412591683456:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787579424.945233:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579424.945236:0:5867:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787579424.945262:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7238 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfdb expref: 53 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579424.945285:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:0.0:1787579424.945290:0:5867:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787579424.946374:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b728c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cff0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787579424.948322:0:5867:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1787579424.948564:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7293 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579424.948579:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579424.948601:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579424.948665:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b728c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cff0 expref: 55 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579424.948682:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7293 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cff0 expref: 54 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579424.948690:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0ce82cbbb00) 00010000:00010000:0.0:1787579424.948693:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787579424.948697:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c9400, rc 0) 00000100:00100000:0.0:1787579424.948772:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+54:10464:x1874412591683456:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 3557us (7006us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1787579424.948781:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 72 00000100:00100000:2.0:1787579424.956468:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579424.956611:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591683712 00000100:00100000:3.0:1787579424.956621:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591683712 00000100:00100000:3.0:1787579424.956678:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 73 00000100:00100000:3.0:1787579424.956697:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+54:10464:x1874412591683712:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787579424.956754:0:9530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579424.956780:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7293 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cff0 expref: 54 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.956797:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0ce82cbbb00) 00010000:00010000:3.0:1787579424.956808:0:9530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787579424.956836:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b72a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.956848:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b72a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.958196:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b72a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.958224:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80031800/0xb72beeaffa1b72a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xd4ba30cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.958234:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80031800/0xb72beeaffa1b72a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd4ba30cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.958241:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80031800/0xb72beeaffa1b72a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd4ba30cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.958316:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b72a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.958323:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b72a1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.958329:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b72a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.958335:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce80030c00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579424.958338:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b72a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.958344:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b72a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.958353:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:3.0:1787579424.958356:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579424.958359:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b72a1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.958376:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b72a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.958390:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80031800/0xb72beeaffa1b72a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd4ba30cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.958396:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80031800/0xb72beeaffa1b72a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd4ba30cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.958401:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80031800/0xb72beeaffa1b72a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd4ba30cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.958405:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce80031800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579424.958408:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80031800/0xb72beeaffa1b72a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd4ba30cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.958414:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80031800/0xb72beeaffa1b72a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd4ba30cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.958495:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xd4ba30cd (ffffa0ce84d55b00) 00010000:00010000:3.0:1787579424.958497:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579424.958500:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80031800/0xb72beeaffa1b72a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd4ba30cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.958505:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80031800/0xb72beeaffa1b72a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd4ba30cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579424.958723:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+53:10464:x1874412591683712:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 2033us (2263us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787579424.958731:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 73 00000100:00100000:2.0:1787579424.975007:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579424.976141:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591683840 00000100:00100000:3.0:1787579424.976152:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591683840 00000100:00100000:3.0:1787579424.976205:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 74 00000100:00100000:3.0:1787579424.976216:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+53:10464:x1874412591683840:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787579424.976234:0:9532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579424.976256:0:9532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80031800/0xb72beeaffa1b72af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cff7 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.976289:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b72b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.976301:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b72b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.976311:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b72b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.981490:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80031800/0xb72beeaffa1b72af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cff7 expref: 55 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.981516:0:9532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b72b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cff7 expref: 54 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579424.981526:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:3.0:1787579424.981529:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787579424.981532:0:9532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce80030c00, rc 0) 00000100:00100000:3.0:1787579424.981890:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+54:10464:x1874412591683840:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 5674us (6889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579424.981899:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 74 00000100:00100000:2.0:1787579425.000766:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579425.002502:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591684096 00000100:00100000:0.0:1787579425.002514:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591684096 00000100:00100000:0.0:1787579425.002586:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 75 00000100:00100000:0.0:1787579425.002596:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+54:10464:x1874412591684096:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787579425.002671:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b72bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.002687:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b72bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.002699:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b72bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787579425.002723:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1787579425.003045:0:5867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1787579425.003056:0:5867:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361194129301ns, next at 362194126913ns, rc = 0 00000004:00010000:0.0:1787579425.003140:0:5867:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0af3b32 reply state 0000000022f91212 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b72bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579425.003150:0:5867:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787579425.003244:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+56:10464:x1874412591684096:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 649us (2487us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1787579425.003252:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 75 00010000:00010000:1.0:1787579425.006162:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b72bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.006179:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b72bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.006186:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b72bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.006191:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579425.006196:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b72bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.006203:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b72bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.006220:0:3306:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:1.0:1787579425.006223:0:3306:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787579425.006238:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b72bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.006245:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b72bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579425.006673:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579425.007164:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591684224 00000100:00100000:0.0:1787579425.007174:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591684224 00000100:00100000:0.0:1787579425.007229:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 76 00000100:00100000:0.0:1787579425.007238:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec119c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+55:10464:x1874412591684224:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787579425.007261:0:9530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579425.007281:0:9530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b72c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01cffe expref: -99 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.007340:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b72c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cffe expref: 56 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.007353:0:9530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b72c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cffe expref: 56 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.007368:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:0.0:1787579425.007371:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787579425.007373:0:9530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c9600, rc 0) 00000100:00100000:0.0:1787579425.007444:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec119c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+56:10464:x1874412591684224:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 207us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579425.007450:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 76 00000100:00100000:0.0:1787579425.011537:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579425.011612:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591684352 00000100:00100000:2.0:1787579425.011622:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591684352 00000100:00100000:2.0:1787579425.011669:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 25 00000100:00100000:2.0:1787579425.011677:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1874412591684352:12345-192.168.206.53@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1787579425.011716:0:6712:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 963d8c17-1326-491b-be60-9002b9296555@192.168.206.53@tcp t0 exp 0000000000000000 cur 361 last 0 00000020:00000080:2.0:1787579425.011759:0:6712:0:(genops.c:1385:class_connect()) connect: client 963d8c17-1326-491b-be60-9002b9296555, cookie 0xb72beeaffa1b72cb 00002000:00100000:2.0:1787579425.011770:0:6712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 963d8c17-1326-491b-be60-9002b9296555/ffffa0ce86534000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787579425.011792:0:6712:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787579425.012075:0:6712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787579425.012103:0:6712:0:(import.c:65:import_set_state_nolock()) ffffa0ce86533000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787579425.012165:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+6:2358:x1874412591684352:12345-192.168.206.53@tcp:8:lhsmtool_posix.0 Request processed in 487us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579425.012173:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 25 00000100:00100000:3.0:1787579425.028631:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579425.028716:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591684480 00000100:00100000:1.0:1787579425.028725:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591684480 00000100:00100000:1.0:1787579425.028788:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 26 00000100:00100000:1.0:1787579425.028797:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+6:0:x1874412591684480:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787579425.029131:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1787579425.122532:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:0.0:1787579425.122549:0:7670:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 963d8c17-1326-491b-be60-9002b9296555 00000100:00100000:2.0:1787579425.122676:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+5:0:x1874412591684480:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 Request processed in 93875us (94049us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787579425.124785:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 26 00000100:00100000:0.0:1787579425.126016:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579425.126096:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591684736 00000100:00100000:2.0:1787579425.126105:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591684736 00000100:00100000:2.0:1787579425.126158:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 19 00000100:00100000:2.0:1787579425.126167:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+56:10464:x1874412591684736:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787579425.126412:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+57:10464:x1874412591684736:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 Request processed in 246us (401us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1787579425.126420:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 19 00000100:00100000:0.0:1787579425.128777:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579425.129026:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591684992 00000100:00100000:3.0:1787579425.129035:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591684992 00000100:00100000:3.0:1787579425.129119:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 77 00000100:00100000:3.0:1787579425.129128:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+57:10464:x1874412591684992:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787579425.129223:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+57:10464:x1874412591684992:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 95us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579425.129231:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 77 00000100:00100000:3.0:1787579425.131247:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579425.131286:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591685120 00000100:00100000:1.0:1787579425.131294:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591685120 00000100:00100000:1.0:1787579425.131333:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 78 00000100:00100000:1.0:1787579425.131342:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+57:10464:x1874412591685120:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787579425.131357:0:5866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579425.131374:0:5866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b72d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d005 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.131438:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b72d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.131451:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b72d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.131462:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b72d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787579425.131495:0:5866:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787579425.131512:0:5866:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b72d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.131616:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b72d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d005 expref: 59 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.131636:0:5866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b72d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d005 expref: 58 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.131645:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:1.0:1787579425.131648:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787579425.131651:0:5866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb47c9400, rc 0) 00000100:00100000:1.0:1787579425.131757:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+58:10464:x1874412591685120:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 415us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579425.131765:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 78 00000100:00100000:1.0:1787579425.134083:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579425.134161:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591685248 00000100:00100000:2.0:1787579425.134169:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591685248 00000100:00100000:2.0:1787579425.134215:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 27 00000100:00100000:2.0:1787579425.134224:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+5:2360:x1874412591685248:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787579425.134239:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579425.134256:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003adfca9b/0xb72beeaffa1b72e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d00c expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787579425.134292:0:6712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c4c20, blocks: 0x1 00010000:00010000:2.0:1787579425.134322:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:2.0:1787579425.134327:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579425.134335:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003adfca9b/0xb72beeaffa1b72e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d00c expref: 6 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.134353:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003adfca9b/0xb72beeaffa1b72e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d00c expref: 6 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.134365:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319a00, rc 0) 00000100:00100000:2.0:1787579425.134419:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+6:2360:x1874412591685248:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 196us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579425.134426:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 27 00000100:00100000:0.0:1787579425.138639:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579425.138751:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591685504 00000100:00100000:3.0:1787579425.138760:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591685504 00000100:00100000:3.0:1787579425.138814:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 79 00000100:00100000:3.0:1787579425.138824:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+58:10464:x1874412591685504:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787579425.139138:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+58:10464:x1874412591685504:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 315us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579425.139147:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 79 00000100:00100000:0.0:1787579425.141840:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579425.141914:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591685632 00000100:00100000:1.0:1787579425.142050:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591685632 00000100:00100000:1.0:1787579425.142105:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 28 00000100:00100000:1.0:1787579425.142115:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+6:10464:x1874412591685632:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787579425.142299:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579425.142318:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c4b6bfd/0xb72beeaffa1b72e7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d013 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.142347:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003adfca9b/0xb72beeaffa1b72e0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d00c expref: 7 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.142356:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579425.142360:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579425.142365:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c4b6bfd/0xb72beeaffa1b72e7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d013 expref: 7 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.142419:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003adfca9b/0xb72beeaffa1b72e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d00c expref: 7 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.142432:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003adfca9b/0xb72beeaffa1b72e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d00c expref: 7 pid: 6712 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579425.142447:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebf293b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6710:1874412616872064:192.168.206.53@tcp:104: 00000100:00100000:2.0:1787579425.142557:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce865f1480 going to sleep for 11 seconds 00000100:00100000:1.0:1787579425.146580:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579425.146653:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebf293b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6710:1874412616872064:192.168.206.53@tcp:104: 00000100:00100000:0.0:1787579425.146654:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591685760 00000100:00100000:0.0:1787579425.146663:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591685760 00010000:00010000:2.0:1787579425.146684:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c4b6bfd/0xb72beeaffa1b72e7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d013 expref: 8 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.146699:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003adfca9b/0xb72beeaffa1b72e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d00c expref: 8 pid: 6712 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.146704:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319000, rc 0) 00000100:00100000:2.0:1787579425.146764:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+8:10464:x1874412591685632:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 4650us (4930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579425.146772:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 28 00000100:00100000:0.0:1787579425.146785:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 42 00000100:00100000:0.0:1787579425.146796:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4697480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+7:2359:x1874412591685760:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579425.146809:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579425.146829:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003adfca9b/0xb72beeaffa1b72e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d00c expref: 7 pid: 6712 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.146842:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003adfca9b/0xb72beeaffa1b72e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d00c expref: 7 pid: 6712 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.146864:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003adfca9b/0xb72beeaffa1b72e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d00c expref: 7 pid: 6712 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.146903:0:5850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787579425.146907:0:5850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787579425.146915:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c4b6bfd/0xb72beeaffa1b72e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d013 expref: 6 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.146971:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c4b6bfd/0xb72beeaffa1b72e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d013 expref: 6 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.147005:0:5850:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003c4b6bfd/0xb72beeaffa1b72e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d013 expref: 6 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579425.147018:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5850:1874412616872192:192.168.206.53@tcp:105: 00000100:00100000:0.0:1787579425.147074:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d11dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787579425.149664:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5850:1874412616872192:192.168.206.53@tcp:105: 00010000:00010000:0.0:1787579425.149705:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579425.149783:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4697480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+6:2359:x1874412591685760:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 2988us (3211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579425.149793:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 42 00000100:00100000:1.0:1787579425.154093:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579425.154249:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591685888 00000100:00100000:3.0:1787579425.154259:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591685888 00002000:00100000:3.0:1787579425.154302:0:6717:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffffa0ceb4694000 x1874412591685888/t0(0) o4->963d8c17-1326-491b-be60-9002b9296555@192.168.206.53@tcp:666/0 lens 504/0 e 0 to 0 dl 1787579436 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787579425.154319:0:6717:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0ceb4694000 with x1874412591685888 ext(0->8) 00002000:00010000:3.0:1787579425.154324:0:6717:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0ceb4694000 00000100:00100000:3.0:1787579425.154355:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:3.0:1787579425.154378:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:963d8c17-1326-491b-be60-9002b9296555+6:2359:x1874412591685888:12345-192.168.206.53@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787579425.155486:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:963d8c17-1326-491b-be60-9002b9296555+8:2359:x1874412591685888:12345-192.168.206.53@tcp:4:lhsmtool_posix.0 Request processed in 1106us (1397us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787579425.155499:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 0 00002000:00100000:2.0:1787579425.155508:0:6717:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffffa0ceb4694000 x1874412591685888/t4294967302(0) o4->963d8c17-1326-491b-be60-9002b9296555@192.168.206.53@tcp:666/0 lens 504/448 e 0 to 0 dl 1787579436 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787579425.155517:0:6717:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0ceb4694000 with x1874412591685888 ext(0->8) 00002000:00010000:2.0:1787579425.155520:0:6717:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0ceb4694000 00000100:00100000:1.0:1787579425.162539:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579425.162628:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591686016 00000100:00100000:3.0:1787579425.162637:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591686016 00000100:00100000:3.0:1787579425.162692:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 80 00000100:00100000:3.0:1787579425.162701:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+58:10464:x1874412591686016:12345-192.168.206.53@tcp:44:lhsmtool_posix.0 00010000:00010000:2.0:1787579425.184030:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787579425.228235:0:5888:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:1.0:1787579425.228247:0:5888:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1787579425.228301:0:5888:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1787579425.228319:0:5888:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1787579425.228336:0:5888:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0ce84fbd240 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1787579425.228340:0:5888:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0ce84e67800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0ce84fbdcc0 00000020:00080000:1.0:1787579425.228356:0:5888:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0ce84e63800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0ce88250400 00000020:00080000:1.0:1787579425.228484:0:5899:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1787579425.228580:0:5899:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1787579425.228590:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787579425.228608:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616872320:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787579425.228667:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579425.228749:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616872320 00000100:00100000:1.0:1787579425.228755:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616872320 00000100:00100000:1.0:1787579425.228799:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787579425.228808:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4694a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3319:x1874412616872320:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787579425.228831:0:6712:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1787579425.228859:0:6712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8c4c1d, atime: 0x6a8c4c1d, ctime: 0x6a8c4c1d, blocks: 0x1 00010000:00010000:1.0:1787579425.228866:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ddec7a0/0xb72beeaffa1b72ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.228880:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=361s v=(0 0) 00010000:00010000:1.0:1787579425.228885:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579425.228891:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ddec7a0/0xb72beeaffa1b72ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.228905:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ddec7a0/0xb72beeaffa1b72ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.228915:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ddec7a0/0xb72beeaffa1b72ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.228961:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ddec7a0/0xb72beeaffa1b72ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.228983:0:6712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787579425.229419:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4694a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3319:x1874412616872320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 611us (752us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787579425.229427:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:1.0:1787579425.229467:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0ceb4695180/2, rc 0, transno 4294967301 00000100:00100000:1.0:1787579425.229473:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616872320:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1787579425.229693:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787579425.229706:0:8475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787579425.229713:0:8475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ddec7a0/0xb72beeaffa1b72ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.229721:0:8475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c8c00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:3.0:1787579425.229726:0:8475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ddec7a0/0xb72beeaffa1b72ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.229735:0:8475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ddec7a0/0xb72beeaffa1b72ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.229750:0:8475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ddec7a0/0xb72beeaffa1b72ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.229758:0:8475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ddec7a0/0xb72beeaffa1b72ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.229775:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579425.229777:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579425.229779:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579425.230013:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787579425.230024:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616872448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787579425.230059:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579425.230093:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616872448 00000100:00100000:0.0:1787579425.230097:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616872448 00000100:00100000:0.0:1787579425.230130:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787579425.230137:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616872448:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787579425.230242:0:6711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787579425.230245:0:6711:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787579424 00002000:00010000:0.0:1787579425.230247:0:6711:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787579425.230249:0:6711:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787579424 -> 1787579424 00002000:00010000:0.0:1787579425.230251:0:6711:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787579425.230280:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3322:x1874412616872448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 143us (220us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787579425.230287:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1787579425.230305:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1787579425.230322:0:3322:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0ce830ece00/2, rc 0, transno 4294967303 00000100:00100000:0.0:1787579425.230327:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616872448:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787579425.233342:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+13:10464:x1874412591686016:12345-192.168.206.53@tcp:44:lhsmtool_posix.0 Request processed in 70633us (70802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579425.233355:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 80 00000100:00100000:1.0:1787579425.238325:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579425.238659:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591686144 00000100:00100000:2.0:1787579425.238668:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591686144 00000100:00100000:2.0:1787579425.238811:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 31 00000100:00100000:2.0:1787579425.238822:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4697100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+8:2360:x1874412591686144:12345-192.168.206.53@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787579425.259033:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1787579425.259053:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:2.0:1787579425.259662:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4697100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+6:2360:x1874412591686144:12345-192.168.206.53@tcp:16:lhsmtool_posix.0 Request processed in 20836us (21339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579425.259674:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 31 00000100:00100000:1.0:1787579425.261839:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579425.261901:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591686400 00000100:00100000:0.0:1787579425.261910:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591686400 00000100:00100000:0.0:1787579425.262000:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 81 00000100:00100000:0.0:1787579425.262010:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+13:10464:x1874412591686400:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787579425.262057:0:5866:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579425.262083:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b72d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d005 expref: 13 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.262100:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:0.0:1787579425.262104:0:5866:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787579425.262143:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8c00/0xb72beeaffa1b72f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.262157:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8c00/0xb72beeaffa1b72f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.262166:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8c00/0xb72beeaffa1b72f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787579425.262716:0:5866:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000947882a reply state 000000003a86d035 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8c00/0xb72beeaffa1b72f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579425.262725:0:5866:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787579425.262817:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+14:10464:x1874412591686400:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 808us (982us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1787579425.262824:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 81 00010000:00010000:0.0:1787579425.266344:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8c00/0xb72beeaffa1b72f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.266360:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8c00/0xb72beeaffa1b72f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.266368:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8c00/0xb72beeaffa1b72f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.266374:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8c00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579425.266378:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8c00/0xb72beeaffa1b72f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.266386:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8c00/0xb72beeaffa1b72f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.266402:0:3305:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:0.0:1787579425.266406:0:3305:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579425.266411:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8c00/0xb72beeaffa1b72f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.266417:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8c00/0xb72beeaffa1b72f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579425.267226:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579425.267404:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591686528 00000100:00100000:0.0:1787579425.267414:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591686528 00000100:00100000:0.0:1787579425.267467:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 32 00000100:00100000:0.0:1787579425.267478:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+6:2360:x1874412591686528:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787579425.267710:0:6711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787579425.267713:0:6711:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787579424 -> 1787579422 00002000:00010000:0.0:1787579425.267714:0:6711:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787579421 00002000:00010000:0.0:1787579425.267716:0:6711:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787579424 -> 1787579422 00002000:00010000:0.0:1787579425.267717:0:6711:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787579425.267764:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+7:2360:x1874412591686528:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 Request processed in 287us (542us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787579425.267770:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 32 00000100:00100000:1.0:1787579425.271320:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579425.271635:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591686784 00000100:00100000:0.0:1787579425.271644:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591686784 00000100:00100000:0.0:1787579425.271996:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 82 00000100:00100000:0.0:1787579425.272008:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+13:10464:x1874412591686784:12345-192.168.206.53@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787579425.272075:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b72fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.272091:0:5867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b72b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cff7 expref: 13 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.272101:0:5867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b72fc lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.272133:0:5867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b72b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cff7 expref: 13 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.272157:0:5867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b72b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cff7 expref: 13 pid: 9532 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579425.272171:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5867:1874412616872576:192.168.206.53@tcp:104: 00000100:00100000:0.0:1787579425.272260:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d11dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787579425.274714:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579425.275026:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591686912 00000100:00100000:2.0:1787579425.275044:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591686912 00010000:00010000:2.0:1787579425.275078:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b72b6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cff7 expref: 14 pid: 9532 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579425.275118:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 43 00000100:00100000:2.0:1787579425.275127:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce90abb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:963d8c17-1326-491b-be60-9002b9296555+14:2360:x1874412591686912:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787579425.275140:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579425.275147:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b72b6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cff7 expref: 14 pid: 9532 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.275160:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b72b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cff7 expref: 14 pid: 9532 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.275180:0:5852:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:2.0:1787579425.275196:0:5852:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b72fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.275205:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b72fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.275213:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b72fc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.275231:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579425.275272:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce90abb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:963d8c17-1326-491b-be60-9002b9296555+14:2360:x1874412591686912:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 146us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579425.275280:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 43 00010000:00010000:0.0:1787579425.275565:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b72b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cff7 expref: 13 pid: 9532 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579425.275585:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5867:1874412616872576:192.168.206.53@tcp:104: 00010000:00010000:0.0:1787579425.275601:0:5867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b72fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.275610:0:5867:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b72fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.275616:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b72fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.275641:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b72fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.275648:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b72fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.275654:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b72fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.276360:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9a00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579425.276374:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b72fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.276383:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b72fc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.276393:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:0.0:1787579425.276396:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787579425.276399:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b72fc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.276406:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b72fc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579425.276637:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+12:10464:x1874412591686784:12345-192.168.206.53@tcp:55:lhsmtool_posix.0 Request processed in 4630us (5323us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787579425.276647:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 82 00000100:00100000:1.0:1787579425.278553:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579425.280306:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591687040 00000100:00100000:3.0:1787579425.280318:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591687040 00000100:00100000:3.0:1787579425.280417:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 33 00000100:00100000:3.0:1787579425.280427:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+7:2359:x1874412591687040:12345-192.168.206.53@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787579425.280530:0:7660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014c42319/0xb72beeaffa1b7303 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.280549:0:7660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c4b6bfd/0xb72beeaffa1b72e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d013 expref: 7 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.280558:0:7660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579425.280572:0:7660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787579425.280577:0:7660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014c42319/0xb72beeaffa1b7303 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.280608:0:7660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c4b6bfd/0xb72beeaffa1b72e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d013 expref: 7 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.280621:0:7660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c4b6bfd/0xb72beeaffa1b72e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d013 expref: 7 pid: 6710 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579425.280634:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7660:1874412616872704:192.168.206.53@tcp:104: 00000100:00100000:3.0:1787579425.280716:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d375000 going to sleep for 11 seconds 00000100:00100000:2.0:1787579425.283846:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579425.284032:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591687168 00000100:00100000:0.0:1787579425.284040:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591687168 00010000:00010000:0.0:1787579425.284074:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c4b6bfd/0xb72beeaffa1b72e7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d013 expref: 8 pid: 6710 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579425.284114:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 44 00000100:00100000:0.0:1787579425.284134:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf290380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+8:2359:x1874412591687168:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579425.284147:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579425.284167:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c4b6bfd/0xb72beeaffa1b72e7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d013 expref: 8 pid: 6710 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.284181:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c4b6bfd/0xb72beeaffa1b72e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d013 expref: 8 pid: 6710 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.284216:0:5851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787579425.284220:0:5851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787579425.284227:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000014c42319/0xb72beeaffa1b7303 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.284236:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014c42319/0xb72beeaffa1b7303 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.284254:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579425.284301:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf290380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+8:2359:x1874412591687168:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 179us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579425.284309:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 44 00010000:00010000:3.0:1787579425.285211:0:7660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c4b6bfd/0xb72beeaffa1b72e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d013 expref: 7 pid: 6710 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579425.285229:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7660:1874412616872704:192.168.206.53@tcp:104: 00010000:00010000:3.0:1787579425.285264:0:7660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000014c42319/0xb72beeaffa1b7303 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.285321:0:7660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000014c42319/0xb72beeaffa1b7303 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.285332:0:7660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014c42319/0xb72beeaffa1b7303 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.285359:0:7660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014c42319/0xb72beeaffa1b7303 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.285368:0:7660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014c42319/0xb72beeaffa1b7303 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.285387:0:7660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014c42319/0xb72beeaffa1b7303 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.285395:0:7660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce80031800 already unused, calling callback (ffffffffc1654230) 00010000:00010000:1.0:1787579425.285399:0:7660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014c42319/0xb72beeaffa1b7303 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.285408:0:7660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014c42319/0xb72beeaffa1b7303 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.285423:0:7660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014c42319/0xb72beeaffa1b7303 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.285431:0:7660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014c42319/0xb72beeaffa1b7303 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579425.285503:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+6:2359:x1874412591687040:12345-192.168.206.53@tcp:1:lhsmtool_posix.0 Request processed in 5076us (6955us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579425.285512:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 33 00000100:00100000:2.0:1787579425.288102:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579425.288260:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591687424 00000100:00100000:3.0:1787579425.288268:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591687424 00000100:00100000:3.0:1787579425.288312:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 83 00000100:00100000:3.0:1787579425.288320:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+12:10464:x1874412591687424:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787579425.288389:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b730a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.288405:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b730a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.288416:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b730a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.288621:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b7311 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.288633:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b72c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cffe expref: 13 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.288641:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b7311 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.288673:0:5868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b72c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cffe expref: 13 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.288686:0:5868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b72c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cffe expref: 13 pid: 9530 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579425.288716:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5868:1874412616872832:192.168.206.53@tcp:104: 00000100:00100000:3.0:1787579425.288776:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d375000 going to sleep for 11 seconds 00000100:00100000:0.0:1787579425.291803:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579425.291861:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591687552 00000100:00100000:1.0:1787579425.291869:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591687552 00000100:00100000:3.0:1787579425.291873:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5868:1874412616872832:192.168.206.53@tcp:104: 00010000:00010000:1.0:1787579425.291959:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b72c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cffe expref: 14 pid: 9530 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.291974:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b7311 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579425.292002:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 45 00000100:00100000:1.0:1787579425.292025:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+14:2360:x1874412591687552:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787579425.292039:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787579425.292047:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b72c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cffe expref: 14 pid: 9530 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.292062:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b72c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cffe expref: 14 pid: 9530 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.292083:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b72c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cffe expref: 14 pid: 9530 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.292098:0:8477:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:1.0:1787579425.292103:0:8477:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b7311 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.292112:0:8477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b7311 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.292119:0:8477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b7311 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579425.292157:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787579425.292187:0:5868:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b7311 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.292195:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b7311 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579425.292208:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+13:2360:x1874412591687552:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 183us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579425.292216:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 45 00000001:00080000:3.0:1787579425.292358:0:5868:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1787579425.292890:0:5868:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1787579425.293064:0:5868:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1787579425.293203:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce812a9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5868:1874412616872960:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787579425.293279:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579425.293302:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceba1e0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787579425.293359:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616872960 00000100:00100000:1.0:1787579425.293365:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616872960 00000100:00100000:1.0:1787579425.293398:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787579425.293403:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5868:x1874412616872960:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787579425.293592:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5868:x1874412616872960:12345-0@lo:1000:mdt00_002.0 Request processed in 188us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579425.293610:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787579425.293641:0:5868:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1787579425.293647:0:5868:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0ce830ece00, transno 4294967303 00000100:00100000:2.0:1787579425.293694:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce812a9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5868:1874412616872960:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787579425.294354:0:5868:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1787579425.294407:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce812a9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5868:1874412616873088:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787579425.294517:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579425.294594:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb1c51b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787579425.294639:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616873088 00000100:00100000:1.0:1787579425.294645:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616873088 00000100:00100000:1.0:1787579425.294678:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787579425.294686:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5868:x1874412616873088:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787579425.294826:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5868:x1874412616873088:12345-0@lo:1000:mdt00_002.0 Request processed in 140us (309us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787579425.294834:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787579425.295437:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce812a9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5868:1874412616873088:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1787579425.295468:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b7311 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.295478:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b7311 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.295485:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b7311 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.295491:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce813fca00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579425.295495:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b7311 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.295515:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b7311 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.295540:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:3.0:1787579425.295543:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787579425.295783:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b7311 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.295792:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b7311 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.295827:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b723f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.295834:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b723f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.295839:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b723f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.295844:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8152f000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579425.295847:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b723f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.295865:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b723f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.295882:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce84d55400) 00010000:00010000:3.0:1787579425.295885:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787579425.295888:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b723f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.295904:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b723f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.296068:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7318 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.296094:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b725b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfe2 expref: 16 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.296170:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7318 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.296202:0:5868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b725b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfe2 expref: 16 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.296216:0:5868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b725b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfe2 expref: 16 pid: 5868 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579425.296228:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce89238e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5868:1874412616873216:192.168.206.53@tcp:104: 00000100:00100000:2.0:1787579425.296294:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb1c519c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787579425.300625:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce89238e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5868:1874412616873216:192.168.206.53@tcp:104: 00010000:00010000:2.0:1787579425.300654:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7318 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579425.304117:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579425.305278:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591687680 00000100:00100000:0.0:1787579425.305288:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591687680 00010000:00010000:0.0:1787579425.305325:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b725b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfe2 expref: 17 pid: 5868 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579425.305392:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 46 00000100:00100000:0.0:1787579425.305401:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89238e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+17:2360:x1874412591687680:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579425.305413:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579425.305420:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b725b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfe2 expref: 17 pid: 5868 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.305433:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b725b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfe2 expref: 17 pid: 5868 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.305467:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b725b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cfe2 expref: 17 pid: 5868 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.305482:0:5850:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce84d55400) 00010000:00010000:0.0:1787579425.305488:0:5850:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7318 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.305497:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7318 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.305504:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7318 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579425.305530:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579425.305577:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89238e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+16:2360:x1874412591687680:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 178us (1468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579425.305585:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 46 00010000:00010000:2.0:1787579425.305635:0:5868:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7318 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.305644:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7318 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.305654:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7318 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.305670:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7318 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.305677:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7318 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.305683:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba319400 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579425.305686:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7318 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.305705:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7318 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.305714:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce84d55400) 00010000:00010000:2.0:1787579425.305717:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579425.305720:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7318 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.305727:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7318 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.305737:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b730a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.305743:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b730a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.305749:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b730a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.305754:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce80030c00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579425.305761:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b730a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.305768:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b730a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.305776:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce84d55400) 00010000:00010000:2.0:1787579425.305778:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787579425.305781:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b730a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.305787:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce80030c00/0xb72beeaffa1b730a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787579425.306059:0:11712:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787579425.306064:0:11712:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787579425.306085:0:11712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787579425.306089:0:11712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787579425.306151:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+15:10464:x1874412591687424:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 17830us (18058us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1787579425.306159:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 83 00000020:00080000:2.0:1787579425.306163:0:5868:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1787579425.310172:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579425.310218:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591687936 00000100:00100000:2.0:1787579425.310228:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591687936 00000100:00100000:2.0:1787579425.310282:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 20 00000100:00100000:2.0:1787579425.310292:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+15:10464:x1874412591687936:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787579425.310977:0:5870:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787579425.311078:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1787579425.311120:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b731f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.311146:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b731f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.311157:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b731f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.311165:0:5870:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b731f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.311171:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b731f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.311177:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b731f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579425.311247:0:5870:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787579425.311288:0:8476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787579425.311295:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b731f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.311302:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba319e00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:3.0:1787579425.311306:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b731f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.311313:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b731f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.311325:0:8476:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0cea147d300) 00010000:00010000:3.0:1787579425.311328:0:8476:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787579425.311332:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b731f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579425.311338:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b731f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579425.311339:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+17:10464:x1874412591687936:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 Request processed in 1047us (1175us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1787579425.311347:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 20 00000020:00080000:2.0:1787579425.311351:0:5870:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787579425.311357:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579425.311359:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579425.311361:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579425.460178:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579425.460357:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591688064 00000100:00100000:2.0:1787579425.460471:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591688064 00000100:00100000:1.0:1787579425.460644:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579425.460955:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591688192 00000100:00100000:3.0:1787579425.460960:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591688192 00000100:00100000:3.0:1787579425.461059:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 54 00000100:00100000:3.0:1787579425.461069:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4696d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+7:2359:x1874412591688192:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1787579425.461143:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4696d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+7:2359:x1874412591688192:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 76us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579425.461162:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 54 00000100:00100000:2.0:1787579425.461884:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 283 00000100:00100000:2.0:1787579425.461896:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+13:2360:x1874412591688064:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1787579425.462361:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+13:2360:x1874412591688064:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 466us (2190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579425.462370:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 283 00000100:00080000:0.0:1787579425.462456:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787579425.464447:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579425.465107:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591688320 00000100:00100000:0.0:1787579425.465116:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591688320 00000100:00100000:0.0:1787579425.465267:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 123 00000100:00100000:0.0:1787579425.465278:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2360:x1874412591688320:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579425.465559:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2360:x1874412591688320:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 281us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579425.465568:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 123 00000100:00080000:3.0:1787579425.465679:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787579425.760402:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1874412616873600:0@lo:400:kworker.0 00000100:00100000:3.0:1787579425.760468:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579425.760527:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787579425.760533:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874412616873472:0@lo:400:kworker.0 00000100:00100000:3.0:1787579425.760556:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579425.760585:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616873600 00000100:00100000:3.0:1787579425.760591:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616873600 00000100:00100000:3.0:1787579425.760639:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616873472 00000100:00100000:3.0:1787579425.760642:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616873472 00000100:00100000:3.0:1787579425.760660:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787579425.760667:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874412616873600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579425.760708:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874412616873600:12345-0@lo:400:kworker.0 Request processed in 42us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579425.760714:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787579425.760735:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787579425.760741:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874412616873472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579425.760767:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874412616873472:12345-0@lo:400:kworker.0 Request processed in 26us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579425.760773:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1787579425.760791:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787579425.760816:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874412616873472:0@lo:400:kworker.0 00000100:00100000:3.0:1787579425.760827:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1874412616873600:0@lo:400:kworker.0 00000100:00100000:1.0:1787579425.761047:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616873344:0@lo:400:kworker.0 00000100:00100000:1.0:1787579425.761081:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579425.761135:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787579425.761143:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3322:1874412616873728:0@lo:400:kworker.0 00000100:00100000:0.0:1787579425.761180:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787579425.761199:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616873856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787579425.761232:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579425.761292:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579425.761310:0:7952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616873856 00000100:00100000:2.0:1787579425.761323:0:7952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616873856 00000100:00100000:3.0:1787579425.761348:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616873344 00000100:00100000:3.0:1787579425.761359:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616873344 00000100:00100000:2.0:1787579425.761360:0:7952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787579425.761371:0:7952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1874412616873856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787579425.761388:0:7952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787579425.761393:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787579425.761402:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3322:x1874412616873344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579425.763505:0:7952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1874412616873856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2129us (2265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579425.763518:0:7952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787579425.763580:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616873728 00000100:00100000:2.0:1787579425.763586:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616873728 00000100:00100000:0.0:1787579425.763597:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616873856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787579425.763634:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1787579425.763637:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787579425.763645:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1874412616873728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579425.763689:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1874412616873728:12345-0@lo:400:kworker.0 Request processed in 48us (2396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579425.763696:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787579425.764421:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3322:x1874412616873344:12345-0@lo:400:kworker.0 Request processed in 3019us (3338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579425.764431:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787579425.764945:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3322:1874412616873728:0@lo:400:kworker.0 00000100:00100000:1.0:1787579425.764959:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616873344:0@lo:400:kworker.0 00010000:00010000:3.0:1787579426.208320:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579426.284562:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce8923a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616873984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787579426.284628:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579426.284710:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616873984 00000100:00100000:2.0:1787579426.284719:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616873984 00000100:00100000:2.0:1787579426.284769:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787579426.284789:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3319:x1874412616873984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787579426.284821:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579426.284943:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3319:x1874412616873984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579426.284951:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787579426.286471:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce8923a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616873984:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787579426.728233:0:12079:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787579426.728242:0:12079:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787579426.728278:0:12079:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787579426.728284:0:12079:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787579426.815578:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579426.815646:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591688576 00000100:00100000:0.0:1787579426.815656:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591688576 00000100:00100000:0.0:1787579426.815717:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 84 00000100:00100000:0.0:1787579426.815728:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+17:10482:x1874412591688576:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1787579426.815750:0:9532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579426.815768:0:9532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7326 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d01a expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579426.816038:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8a00/0xb72beeaffa1b732d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579426.816052:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8a00/0xb72beeaffa1b732d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579426.816065:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8a00/0xb72beeaffa1b732d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579426.816076:0:9532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787579426.817430:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7326 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d01a expref: 20 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579426.817455:0:9532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8a00/0xb72beeaffa1b732d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d01a expref: 19 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579426.817464:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:0.0:1787579426.817478:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787579426.817481:0:9532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c8a00, rc 0) 00000100:00100000:0.0:1787579426.817550:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+19:10482:x1874412591688576:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 1823us (1978us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1787579426.817559:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 84 00000100:00100000:2.0:1787579426.823579:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579426.823670:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591688704 00000100:00100000:3.0:1787579426.823690:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591688704 00000100:00100000:3.0:1787579426.823746:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 85 00000100:00100000:3.0:1787579426.823757:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+19:10482:x1874412591688704:12345-192.168.206.53@tcp:34:lfs.0 00010000:00010000:3.0:1787579426.823826:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b733b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.823854:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b733b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.823865:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b733b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.824053:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b7342 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.824063:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b7342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.824071:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b7342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.824345:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7349 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.824360:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.824367:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787579426.824404:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.824417:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b733b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.824423:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b733b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.824430:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b733b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.824436:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce813fca00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579426.824439:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b733b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.824447:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b733b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.824459:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:3.0:1787579426.824461:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579426.824466:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b733b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.824472:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b733b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.824490:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b7342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.824496:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b7342 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.824502:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b7342 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.824507:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce813fde00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579426.824510:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b7342 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.824516:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b7342 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.824523:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0ce988a2300) 00010000:00010000:3.0:1787579426.824525:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579426.824528:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b7342 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.824534:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b7342 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.824550:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.824556:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7349 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.824562:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7349 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.824571:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8152f000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579426.824575:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7349 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.824581:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7349 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.824589:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce988a2000) 00010000:00010000:3.0:1787579426.824591:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579426.824593:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7349 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.824599:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7349 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579426.826364:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+19:10482:x1874412591688704:12345-192.168.206.53@tcp:34:lfs.0 Request processed in 2600us (2785us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579426.826375:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 85 00000100:00100000:0.0:1787579426.884375:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579426.884454:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591688960 00000100:00100000:2.0:1787579426.884463:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591688960 00000100:00100000:2.0:1787579426.884517:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 86 00000100:00100000:2.0:1787579426.884526:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+19:10485:x1874412591688960:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1787579426.884545:0:5866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579426.884563:0:5866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7350 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d021 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.884648:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b7357 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.884661:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b7357 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.884671:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b7357 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.884695:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b735e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.884703:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b735e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.884710:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b735e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.885055:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7365 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.885065:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7365 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.885085:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7365 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579426.885095:0:5866:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787579426.885180:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b7357 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.885188:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b7357 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.885194:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b7357 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.885200:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318c00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579426.885204:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b7357 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.885210:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b7357 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.885221:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:2.0:1787579426.885224:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579426.885229:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b7357 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.885234:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b7357 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.885244:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b735e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.885250:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b735e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.885262:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b735e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.885267:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579426.885270:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b735e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.885276:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b735e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.885285:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0cea147de00) 00010000:00010000:2.0:1787579426.885288:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579426.885290:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b735e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.885296:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b735e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.885335:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7350 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d021 expref: 22 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.885348:0:5866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7365 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d021 expref: 21 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.885356:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0cea147d900) 00010000:00010000:2.0:1787579426.885358:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787579426.885360:0:5866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319600, rc 0) 00000100:00100000:2.0:1787579426.885424:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+21:10485:x1874412591688960:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 898us (1057us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1787579426.885441:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 86 00000100:00100000:1.0:1787579426.891022:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579426.891178:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591689088 00000100:00100000:3.0:1787579426.891187:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591689088 00000100:00100000:3.0:1787579426.891237:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 87 00000100:00100000:3.0:1787579426.891247:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+21:10485:x1874412591689088:12345-192.168.206.53@tcp:54:lfs.0 00010000:00010000:3.0:1787579426.891308:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7373 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.891322:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7373 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.891334:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7373 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.891364:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7373 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.891371:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7373 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.891378:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7373 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.891384:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8152f000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579426.891388:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7373 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.891395:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7373 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.891406:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0cea147d900) 00010000:00010000:3.0:1787579426.891409:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787579426.891413:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7373 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.891420:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7373 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579426.891576:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+21:10485:x1874412591689088:12345-192.168.206.53@tcp:54:lfs.0 Request processed in 329us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579426.891584:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 87 00000100:00100000:1.0:1787579426.893390:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579426.893480:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591689344 00000100:00100000:0.0:1787579426.893488:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591689344 00000100:00100000:0.0:1787579426.893535:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 21 00000100:00100000:0.0:1787579426.893543:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce9c705850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+21:10485:x1874412591689344:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:0.0:1787579426.893823:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce9c705850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+22:10485:x1874412591689344:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 279us (437us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1787579426.893831:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 21 00000100:00100000:0.0:1787579426.929690:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579426.929791:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591689600 00000100:00100000:3.0:1787579426.929800:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591689600 00000100:00100000:3.0:1787579426.929860:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 88 00000100:00100000:3.0:1787579426.929884:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+22:10006:x1874412591689600:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:3.0:1787579426.930254:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579426.930275:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b737a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d028 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.930369:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7381 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.930383:0:5867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7365 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d021 expref: 23 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.930391:0:5867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7381 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.930423:0:5867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7365 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d021 expref: 23 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.930437:0:5867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7365 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d021 expref: 23 pid: 5866 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579426.930451:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f15500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5867:1874412616874112:192.168.206.53@tcp:104: 00000100:00100000:3.0:1787579426.930585:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cec1bcb600 going to sleep for 11 seconds 00000100:00100000:1.0:1787579426.938298:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579426.938360:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591689728 00000100:00100000:2.0:1787579426.938370:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591689728 00000100:00100000:3.0:1787579426.938403:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f15500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5867:1874412616874112:192.168.206.53@tcp:104: 00010000:00010000:2.0:1787579426.938409:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7365 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d021 expref: 24 pid: 5866 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.938427:0:5867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7381 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579426.938450:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 47 00000100:00100000:2.0:1787579426.938459:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4694e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:963d8c17-1326-491b-be60-9002b9296555+24:2360:x1874412591689728:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787579426.938472:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579426.938479:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7365 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d021 expref: 24 pid: 5866 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.938490:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7365 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d021 expref: 24 pid: 5866 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.938509:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7365 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d021 expref: 24 pid: 5866 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.938523:0:5852:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0cea147d900) 00010000:00010000:2.0:1787579426.938528:0:5852:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7381 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.938537:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7381 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.938544:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7381 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579426.938588:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579426.938640:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4694e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:963d8c17-1326-491b-be60-9002b9296555+23:2360:x1874412591689728:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 182us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579426.938648:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 47 00010000:00010000:3.0:1787579426.938724:0:5867:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7381 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.938743:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7381 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579426.938761:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787579426.939038:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b737a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d028 expref: 24 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.939055:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7381 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d028 expref: 23 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.939063:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0cea147d900) 00010000:00010000:3.0:1787579426.939065:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787579426.939068:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8152ea00, rc 0) 00000100:00100000:3.0:1787579426.939110:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+23:10006:x1874412591689600:12345-192.168.206.53@tcp:101:bash.0 Request processed in 9229us (9435us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1787579426.939117:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 88 00000100:00100000:1.0:1787579426.946835:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579426.947353:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591689984 00000100:00100000:0.0:1787579426.947362:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591689984 00000100:00100000:0.0:1787579426.947449:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 89 00000100:00100000:0.0:1787579426.947459:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+23:10006:x1874412591689984:12345-192.168.206.53@tcp:36:bash.0 00010000:00010000:0.0:1787579426.947685:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b738f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579426.947700:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b738f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579426.947711:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b738f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787579426.947760:0:9532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1787579426.947800:0:9532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038e8fd5b reply state 00000000997e0be1 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b738f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579426.947809:0:9532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787579426.948013:0:9532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1787579426.948107:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+27:10006:x1874412591689984:12345-192.168.206.53@tcp:36:bash.0 Request processed in 648us (1281us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1787579426.948250:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 89 00000020:00080000:0.0:1787579426.948256:0:9532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787579426.951037:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579426.951118:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591690112 00000100:00100000:3.0:1787579426.951127:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591690112 00000100:00100000:3.0:1787579426.951177:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 90 00000100:00100000:3.0:1787579426.951187:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+27:10006:x1874412591690112:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:3.0:1787579426.951207:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579426.951224:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7396 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d02f expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.951316:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7396 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d02f expref: 28 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.951361:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7396 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d02f expref: 28 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579426.951380:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0cea147d900) 00010000:00010000:3.0:1787579426.951383:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787579426.951386:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8152e200, rc 0) 00000100:00100000:3.0:1787579426.951430:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+28:10006:x1874412591690112:12345-192.168.206.53@tcp:101:bash.0 Request processed in 244us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579426.951437:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 90 00010000:00010000:1.0:1787579426.953240:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b738f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579426.953254:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b738f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579426.953262:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b738f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579426.953269:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579426.953273:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b738f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579426.953281:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b738f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579426.953295:0:3306:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0cea147d900) 00010000:00010000:1.0:1787579426.953299:0:3306:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579426.953304:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b738f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579426.953310:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b738f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579426.956051:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579426.956236:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591690240 00000100:00100000:1.0:1787579426.956244:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591690240 00000100:00100000:1.0:1787579426.956304:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 34 00000100:00100000:1.0:1787579426.956313:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8923b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+6:10006:x1874412591690240:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:1.0:1787579426.956345:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579426.956363:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000524d8183/0xb72beeaffa1b739d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d036 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787579426.956386:0:6712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8c4c1e, atime: 0x6a8c4c1d, ctime: 0x6a8c4c1e, blocks: 0xb 00010000:00010000:1.0:1787579426.956405:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=363s v=(0 0) 00010000:00010000:1.0:1787579426.956410:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579426.956418:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000524d8183/0xb72beeaffa1b739d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d036 expref: 7 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579426.956434:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000524d8183/0xb72beeaffa1b739d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d036 expref: 7 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579426.956447:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb47c9e00, rc 0) 00000100:00100000:1.0:1787579426.956496:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8923b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+7:10006:x1874412591690240:12345-192.168.206.53@tcp:101:bash.0 Request processed in 184us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579426.956503:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 34 00000100:00100000:0.0:1787579426.959797:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579426.960084:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591690368 00000100:00100000:1.0:1787579426.960094:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591690368 00002000:00010000:1.0:1787579426.960140:0:6715:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1787579426.960145:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0cec1abea00 with x1874412591690368 ext(0->18446744073709551615) 00002000:00010000:1.0:1787579426.960156:0:6715:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0cec1abea00. 00000100:00100000:1.0:1787579426.960183:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 1 00000100:00100000:1.0:1787579426.960194:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:963d8c17-1326-491b-be60-9002b9296555+7:2362:x1874412591690368:12345-192.168.206.53@tcp:10:bash.0 00002000:00010000:1.0:1787579426.960606:0:6715:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787579426.960621:0:6715:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787579422 -> 1787579426 00002000:00010000:1.0:1787579426.960624:0:6715:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787579421 -> 1787579421 00002000:00010000:1.0:1787579426.960626:0:6715:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787579422 -> 1787579426 00002000:00010000:1.0:1787579426.960629:0:6715:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787579426.960811:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:963d8c17-1326-491b-be60-9002b9296555+8:2362:x1874412591690368:12345-192.168.206.53@tcp:10:bash.0 Request processed in 618us (1022us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787579426.960819:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 1 00002000:00010000:1.0:1787579426.960823:0:6715:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1787579426.960826:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0cec1abea00 with x1874412591690368 ext(0->18446744073709551615) 00002000:00010000:1.0:1787579426.960831:0:6715:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0cec1abea00. 00000100:00100000:2.0:1787579426.994003:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579426.994042:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579426.994387:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591690624 00000100:00100000:1.0:1787579426.994396:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591690624 00000100:00100000:1.0:1787579426.994451:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 35 00000100:00100000:1.0:1787579426.994461:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89238700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+8:2362:x1874412591690624:12345-192.168.206.53@tcp:16:kworker.0 00000100:00100000:3.0:1787579426.996726:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591690496 00000100:00100000:3.0:1787579426.996739:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591690496 00002000:00100000:3.0:1787579426.996778:0:6717:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->7) req@ffffa0ce8923aa00 x1874412591690496/t0(0) o4->963d8c17-1326-491b-be60-9002b9296555@192.168.206.53@tcp:667/0 lens 496/0 e 0 to 0 dl 1787579437 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787579426.996790:0:6717:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0ce8923aa00 with x1874412591690496 ext(0->7) 00002000:00010000:3.0:1787579426.996794:0:6717:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0ce8923aa00 00000100:00100000:3.0:1787579426.996813:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 2 00000100:00100000:3.0:1787579426.996821:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8923aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:963d8c17-1326-491b-be60-9002b9296555+9:2362:x1874412591690496:12345-192.168.206.53@tcp:4:bash.0 00000100:00100000:3.0:1787579426.997279:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8923aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:963d8c17-1326-491b-be60-9002b9296555+11:2362:x1874412591690496:12345-192.168.206.53@tcp:4:bash.0 Request processed in 457us (3234us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787579426.997632:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 2 00002000:00100000:3.0:1787579426.997641:0:6717:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->7) req@ffffa0ce8923aa00 x1874412591690496/t4294967307(0) o4->963d8c17-1326-491b-be60-9002b9296555@192.168.206.53@tcp:667/0 lens 496/448 e 0 to 0 dl 1787579437 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787579426.997649:0:6717:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0ce8923aa00 with x1874412591690496 ext(0->7) 00002000:00010000:3.0:1787579426.997653:0:6717:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0ce8923aa00 00000001:00080000:0.0:1787579427.028800:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1787579427.031601:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1787579427.031620:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:2.0:1787579427.032095:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579427.032211:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591690752 00000100:00100000:3.0:1787579427.032221:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591690752 00000100:00100000:1.0:1787579427.032313:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89238700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+8:2362:x1874412591690624:12345-192.168.206.53@tcp:16:kworker.0 Request processed in 37850us (38316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579427.032324:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 35 00000100:00100000:3.0:1787579427.032374:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 91 00000100:00100000:3.0:1787579427.032386:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8923a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+27:10499:x1874412591690752:12345-192.168.206.53@tcp:34:lfs.0 00010000:00010000:3.0:1787579427.032446:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b73a4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.032461:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b73a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.032472:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b73a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.032485:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b73ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.032491:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b73ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.032497:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b73ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.032735:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b73b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.032743:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b73b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.032749:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b73b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787579427.032886:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:3.0:1787579427.032960:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b73b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.032980:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b73a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.032986:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b73a4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.033864:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b73a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.033874:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8152f000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579427.033878:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b73a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.033886:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b73a4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.033900:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:3.0:1787579427.033903:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579427.033918:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b73a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.033955:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b73a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.033971:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b73ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.033978:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b73ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.033984:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b73ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.033997:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8152ec00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579427.034000:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b73ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.034006:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b73ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.034014:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0ce988a2000) 00010000:00010000:3.0:1787579427.034017:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579427.034020:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b73ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.034025:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b73ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.034041:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b73b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.034047:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b73b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.034053:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b73b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.034058:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce813fde00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579427.034061:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b73b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.034067:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b73b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.034083:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0cea147d900) 00010000:00010000:3.0:1787579427.034086:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579427.034089:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b73b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.034095:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b73b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579427.034159:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8923a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+27:10499:x1874412591690752:12345-192.168.206.53@tcp:34:lfs.0 Request processed in 1773us (2066us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579427.034168:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 91 00000100:00100000:2.0:1787579427.068399:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579427.068480:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591691008 00000100:00100000:0.0:1787579427.068491:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591691008 00000100:00100000:0.0:1787579427.068549:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 92 00000100:00100000:0.0:1787579427.068560:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+27:10502:x1874412591691008:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1787579427.068579:0:9532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579427.068600:0:9532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b73b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d03d expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.068681:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b73c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.068695:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b73c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.068705:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b73c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.068731:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b73c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.068739:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b73c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.068746:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b73c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.069119:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b73ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.069138:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b73ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.069145:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b73ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579427.069154:0:9532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787579427.069242:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b73c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.069249:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b73c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.069254:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b73c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.069259:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579427.069263:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b73c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.069278:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b73c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.070530:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:0.0:1787579427.070533:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579427.070539:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b73c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.070546:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b73c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.070562:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b73c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.070569:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b73c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.070576:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b73c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.070581:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8400 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579427.070585:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b73c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.070591:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b73c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.070599:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0ce82cbbe00) 00010000:00010000:0.0:1787579427.070601:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579427.070613:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b73c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.070633:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b73c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.070681:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b73b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d03d expref: 30 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.070694:0:9532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b73ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d03d expref: 29 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.070701:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0cea147d900) 00010000:00010000:0.0:1787579427.070703:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787579427.070706:0:9532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c8800, rc 0) 00000100:00100000:0.0:1787579427.072136:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+29:10502:x1874412591691008:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 3571us (3736us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1787579427.072146:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 92 00000100:00100000:0.0:1787579427.078026:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579427.078173:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591691136 00000100:00100000:2.0:1787579427.078182:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591691136 00000100:00100000:2.0:1787579427.078252:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 93 00000100:00100000:2.0:1787579427.078262:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+29:10502:x1874412591691136:12345-192.168.206.53@tcp:54:lfs.0 00010000:00010000:2.0:1787579427.078335:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b73dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.078352:0:5866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7381 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d028 expref: 29 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.078361:0:5866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b73dc lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.078394:0:5866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7381 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d028 expref: 29 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.078406:0:5866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7381 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d028 expref: 29 pid: 5867 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579427.078435:0:5866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1427100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5866:1874412616874240:192.168.206.53@tcp:104: 00000100:00100000:2.0:1787579427.078517:0:5866:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceba43d540 going to sleep for 11 seconds 00000100:00100000:2.0:1787579427.081311:0:5866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1427100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5866:1874412616874240:192.168.206.53@tcp:104: 00010000:00010000:2.0:1787579427.081336:0:5866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b73dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579427.082180:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579427.082267:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591691392 00000100:00100000:2.0:1787579427.082274:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591691392 00000100:00100000:2.0:1787579427.082325:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 22 00000100:00100000:2.0:1787579427.082335:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+30:5601:x1874412591691392:12345-192.168.206.53@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787579427.082674:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+31:5601:x1874412591691392:12345-192.168.206.53@tcp:35:ldlm_bl.0 Request processed in 339us (495us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1787579427.082693:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 22 00000100:00100000:1.0:1787579427.085842:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579427.086146:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591691520 00000100:00100000:3.0:1787579427.086155:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591691520 00010000:00010000:3.0:1787579427.086192:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7381 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d028 expref: 31 pid: 5867 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579427.086270:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 48 00000100:00100000:3.0:1787579427.086281:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+31:2359:x1874412591691520:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787579427.086295:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579427.086301:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7381 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d028 expref: 31 pid: 5867 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.086314:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7381 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d028 expref: 31 pid: 5867 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.086333:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7381 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d028 expref: 31 pid: 5867 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.086361:0:5851:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0cea147d900) 00010000:00010000:3.0:1787579427.086366:0:5851:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b73dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.086374:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b73dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.086381:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b73dc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.086424:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579427.086478:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+30:2359:x1874412591691520:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 198us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579427.086485:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 48 00010000:00010000:2.0:1787579427.086545:0:5866:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b73dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.086554:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b73dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.086582:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b73dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.086589:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b73dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.086596:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b73dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.086615:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318c00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579427.086619:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b73dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.086626:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b73dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.086636:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0cea147d900) 00010000:00010000:2.0:1787579427.086638:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787579427.086641:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b73dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.086648:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b73dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579427.086701:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+29:10502:x1874412591691136:12345-192.168.206.53@tcp:54:lfs.0 Request processed in 8441us (8684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579427.086709:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 93 00000100:00100000:0.0:1787579427.090420:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579427.090549:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591691776 00000100:00100000:2.0:1787579427.090558:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591691776 00000100:00100000:2.0:1787579427.090608:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 23 00000100:00100000:2.0:1787579427.090618:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+29:10502:x1874412591691776:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:2.0:1787579427.090857:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+30:10502:x1874412591691776:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 231us (436us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1787579427.090864:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 23 00000100:00100000:1.0:1787579427.173192:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579427.173334:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591692032 00000100:00100000:3.0:1787579427.173343:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591692032 00000100:00100000:3.0:1787579427.173508:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 94 00000100:00100000:3.0:1787579427.173518:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+30:10513:x1874412591692032:12345-192.168.206.53@tcp:101:cat.0 00010000:00010000:3.0:1787579427.173539:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579427.173557:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b73e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d044 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.173621:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b73ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.173634:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b73ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.173644:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b73ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.173673:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b73f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.173794:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b73f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.173802:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b73f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.174492:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b73f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.174503:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b73f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.174511:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b73f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579427.174521:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1787579427.174608:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b73ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.174615:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b73ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.174621:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b73ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.174627:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce813fca00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579427.174631:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b73ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.174648:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b73ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.174660:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:3.0:1787579427.174663:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579427.174667:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b73ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.174673:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b73ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.175887:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b73f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.175898:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b73f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.175905:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b73f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.175921:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8152ea00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579427.176017:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b73f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.176025:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b73f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.176038:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0ce988a2000) 00010000:00010000:3.0:1787579427.176041:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579427.176045:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b73f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.176066:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b73f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.176134:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b73e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d044 expref: 33 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.176150:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b73f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d044 expref: 32 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.176157:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0cea147d900) 00010000:00010000:3.0:1787579427.176160:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787579427.176162:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8152ec00, rc 0) 00000100:00100000:3.0:1787579427.176237:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+32:10513:x1874412591692032:12345-192.168.206.53@tcp:101:cat.0 Request processed in 2719us (3053us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1787579427.176245:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 94 00000100:00100000:1.0:1787579427.181833:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579427.181888:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591692288 00000100:00100000:2.0:1787579427.181898:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591692288 00000100:00100000:2.0:1787579427.181977:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 24 00000100:00100000:2.0:1787579427.181998:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+32:10513:x1874412591692288:12345-192.168.206.53@tcp:35:cat.0 00000100:00100000:2.0:1787579427.182197:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+33:10513:x1874412591692288:12345-192.168.206.53@tcp:35:cat.0 Request processed in 200us (372us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1787579427.182205:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 24 00000100:00100000:1.0:1787579427.217037:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579427.217177:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591692544 00000100:00100000:0.0:1787579427.217186:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591692544 00000100:00100000:0.0:1787579427.217241:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 95 00000100:00100000:0.0:1787579427.217251:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+33:10514:x1874412591692544:12345-192.168.206.53@tcp:36:rm.0 00010000:00010000:0.0:1787579427.217304:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787579427.217329:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b73f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d044 expref: 33 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.217370:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b73ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d03d expref: 32 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.217383:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7396 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d02f expref: 31 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.217394:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0cea147d900) 00010000:00010000:0.0:1787579427.217403:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787579427.217423:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7406 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.217536:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7406 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.217546:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7406 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.217562:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8600/0xb72beeaffa1b740d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.217570:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8600/0xb72beeaffa1b740d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.217576:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8600/0xb72beeaffa1b740d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.218313:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7414 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.218324:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7414 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.218347:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7414 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787579427.221569:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1787579427.221590:0:9532:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 363412662535ns, next at 364412659280ns, rc = 0 00010000:00010000:0.0:1787579427.222186:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b741b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.222204:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b741b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.222215:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b741b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.222224:0:9532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b741b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.222230:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b741b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.222236:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b741b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.222261:0:9532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787579427.222282:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7414 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.222289:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7414 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.222294:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7414 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.222318:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579427.222323:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7414 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.222330:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7414 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.222350:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce82cbb500) 00010000:00010000:0.0:1787579427.222354:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787579427.222358:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7414 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.222364:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7414 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.222391:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7406 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.222398:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7406 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.222408:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7406 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.222414:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579427.222417:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7406 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.222422:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7406 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.222617:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787579427.222630:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b741b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.222637:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9400 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579427.222640:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b741b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.222647:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b741b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.222663:0:5854:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0ce82cbb500) 00010000:00010000:2.0:1787579427.222665:0:5854:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787579427.222669:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b741b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.222674:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b741b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.223826:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:0.0:1787579427.223829:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579427.223834:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7406 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.223841:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7406 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787579427.223856:0:9532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000894e6ecf reply state 00000000b186a5b7 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8600/0xb72beeaffa1b740d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579427.223865:0:9532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787579427.224582:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+32:10514:x1874412591692544:12345-192.168.206.53@tcp:36:rm.0 Request processed in 7327us (7548us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1787579427.224593:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 95 00010000:00010000:2.0:1787579427.224626:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579427.224629:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579427.224632:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579427.232136:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579427.236123:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8600/0xb72beeaffa1b740d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.236140:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8600/0xb72beeaffa1b740d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.236147:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8600/0xb72beeaffa1b740d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.236153:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8600 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579427.236157:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8600/0xb72beeaffa1b740d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.236164:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8600/0xb72beeaffa1b740d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.236196:0:3305:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0ce82cbbe00) 00010000:00010000:0.0:1787579427.236199:0:3305:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579427.236204:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8600/0xb72beeaffa1b740d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.236210:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8600/0xb72beeaffa1b740d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579427.288174:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579427.288265:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591692800 00000100:00100000:2.0:1787579427.288275:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591692800 00000100:00100000:2.0:1787579427.288333:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 96 00000100:00100000:2.0:1787579427.288342:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+31:10520:x1874412591692800:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:2.0:1787579427.288375:0:5866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579427.288392:0:5866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b7422 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d04b expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.288511:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7429 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.288526:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7429 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.288537:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7429 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.288552:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7430 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.288559:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7430 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.288566:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7430 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787579427.289086:0:5866:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1787579427.289231:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7437 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.289240:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7437 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.289247:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7437 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.289288:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7429 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.289294:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7429 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.289301:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7429 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.289306:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579427.289310:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7429 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.289317:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7429 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.289329:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:2.0:1787579427.289332:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579427.289336:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7429 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.289342:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7429 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787579427.289354:0:5866:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000689418a0 reply state 0000000045974524 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7430 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579427.289363:0:5866:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787579427.289389:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b7422 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d04b expref: 34 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.289414:0:5866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7437 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d04b expref: 33 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.289421:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0cea147d700) 00010000:00010000:2.0:1787579427.289424:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787579427.289426:0:5866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba318400, rc 0) 00000100:00100000:2.0:1787579427.289489:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+34:10520:x1874412591692800:12345-192.168.206.53@tcp:101:bash.0 Request processed in 1147us (1324us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1787579427.289498:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 96 00000100:00100000:1.0:1787579427.293687:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579427.294135:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591692928 00000100:00100000:3.0:1787579427.294144:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591692928 00000100:00100000:3.0:1787579427.294208:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 36 00000100:00100000:3.0:1787579427.294217:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+7:2359:x1874412591692928:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:3.0:1787579427.294231:0:7660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579427.294293:0:7660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f7a4506/0xb72beeaffa1b7445 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d052 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787579427.294326:0:7660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787579427.294345:0:7660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=363s v=(0 0) 00010000:00010000:3.0:1787579427.294362:0:7660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579427.294371:0:7660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f7a4506/0xb72beeaffa1b7445 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d052 expref: 8 pid: 7660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.294389:0:7660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005f7a4506/0xb72beeaffa1b7445 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d052 expref: 8 pid: 7660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.294402:0:7660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8152ea00, rc 0) 00000100:00100000:3.0:1787579427.294456:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+8:2359:x1874412591692928:12345-192.168.206.53@tcp:101:bash.0 Request processed in 240us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579427.294462:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 36 00000100:00080000:0.0:1787579427.294812:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787579427.296239:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7430 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.296252:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7430 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.296259:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7430 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.296265:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba319600 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579427.296269:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7430 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.296276:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7430 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.296291:0:3306:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0cea147de00) 00010000:00010000:2.0:1787579427.296293:0:3306:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579427.296297:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7430 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.296325:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7430 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579427.298249:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579427.298323:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591693056 00000100:00100000:0.0:1787579427.298331:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591693056 00000100:00100000:0.0:1787579427.298379:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 37 00000100:00100000:0.0:1787579427.298388:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+8:10520:x1874412591693056:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:0.0:1787579427.298403:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579427.298417:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082c9f210/0xb72beeaffa1b744c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d059 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.298444:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005f7a4506/0xb72beeaffa1b7445 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d052 expref: 9 pid: 7660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.298452:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787579427.298457:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787579427.298461:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082c9f210/0xb72beeaffa1b744c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d059 expref: 9 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.298491:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005f7a4506/0xb72beeaffa1b7445 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d052 expref: 9 pid: 7660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.298519:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005f7a4506/0xb72beeaffa1b7445 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d052 expref: 9 pid: 7660 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579427.298533:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1abdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6711:1874412616874368:192.168.206.53@tcp:104: 00000100:00100000:0.0:1787579427.298608:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d11dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787579427.301328:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1abdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6711:1874412616874368:192.168.206.53@tcp:104: 00010000:00010000:3.0:1787579427.301361:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000082c9f210/0xb72beeaffa1b744c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d059 expref: 9 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.301380:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c8600, rc 0) 00000100:00100000:3.0:1787579427.301429:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+9:10520:x1874412591693056:12345-192.168.206.53@tcp:101:bash.0 Request processed in 3042us (3185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579427.301437:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 37 00000100:00100000:3.0:1787579427.302402:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579427.302542:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591693184 00000100:00100000:2.0:1787579427.302549:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591693184 00010000:00010000:2.0:1787579427.302578:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005f7a4506/0xb72beeaffa1b7445 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d052 expref: 9 pid: 7660 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579427.302613:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 49 00000100:00100000:2.0:1787579427.302622:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:963d8c17-1326-491b-be60-9002b9296555+9:2360:x1874412591693184:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787579427.302633:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579427.302652:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005f7a4506/0xb72beeaffa1b7445 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d052 expref: 9 pid: 7660 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.302664:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005f7a4506/0xb72beeaffa1b7445 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d052 expref: 9 pid: 7660 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.302748:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f7a4506/0xb72beeaffa1b7445 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d052 expref: 9 pid: 7660 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.302762:0:5852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579427.302767:0:5852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579427.302775:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000082c9f210/0xb72beeaffa1b744c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d059 expref: 8 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.302802:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082c9f210/0xb72beeaffa1b744c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d059 expref: 8 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.302836:0:5852:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000082c9f210/0xb72beeaffa1b744c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d059 expref: 8 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579427.303459:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1425f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5852:1874412616874496:192.168.206.53@tcp:105: 00000100:00100000:2.0:1787579427.303533:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceba43d540 going to sleep for 11 seconds 00000100:00100000:3.0:1787579427.307613:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1425f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5852:1874412616874496:192.168.206.53@tcp:105: 00010000:00010000:3.0:1787579427.307638:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579427.307686:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:963d8c17-1326-491b-be60-9002b9296555+8:2360:x1874412591693184:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 5063us (5286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579427.307697:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 49 00000100:00100000:2.0:1787579427.309894:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579427.309960:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591693440 00000100:00100000:0.0:1787579427.309969:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591693440 00000100:00100000:0.0:1787579427.310027:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 25 00000100:00100000:0.0:1787579427.310038:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+33:10520:x1874412591693440:12345-192.168.206.53@tcp:35:bash.0 00000100:00100000:0.0:1787579427.310324:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+34:10520:x1874412591693440:12345-192.168.206.53@tcp:35:bash.0 Request processed in 287us (437us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1787579427.310333:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 25 00000001:00080000:1.0:1787579427.325026:0:6735:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:1.0:1787579427.325040:0:6735:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000040:00080000:3.0:1787579427.360315:0:11712:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787579427.360324:0:11712:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787579427.360355:0:11712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787579427.360362:0:11712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787579427.437145:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579427.437307:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591693568 00000100:00100000:2.0:1787579427.437316:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591693568 00000100:00100000:2.0:1787579427.437377:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 97 00000100:00100000:2.0:1787579427.437387:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+34:10536:x1874412591693568:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1787579427.437407:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579427.437428:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b7453 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d060 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.437488:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b745a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.437501:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b745a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.437512:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b745a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579427.437566:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787579427.437582:0:5867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787579427.437608:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b745a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.437634:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b7453 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d060 expref: 36 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.437652:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b745a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d060 expref: 35 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.437660:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:2.0:1787579427.437663:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787579427.437666:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba318e00, rc 0) 00000100:00100000:2.0:1787579427.437741:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+35:10536:x1874412591693568:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 355us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579427.437748:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 97 00000100:00100000:2.0:1787579427.443100:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579427.444390:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591693824 00000100:00100000:0.0:1787579427.444401:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591693824 00000100:00100000:0.0:1787579427.444504:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 98 00000100:00100000:0.0:1787579427.444514:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+35:10536:x1874412591693824:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1787579427.444531:0:9532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579427.444549:0:9532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7461 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d067 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.444650:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7468 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.444664:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7468 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.444698:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7468 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579427.444709:0:9532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787579427.444821:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7461 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d067 expref: 38 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.444839:0:9532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7468 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d067 expref: 37 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.444847:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0cea147d700) 00010000:00010000:0.0:1787579427.444850:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787579427.444854:0:9532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c9e00, rc 0) 00000100:00100000:0.0:1787579427.444966:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+37:10536:x1874412591693824:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 453us (1873us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1787579427.444973:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 98 00000100:00100000:3.0:1787579427.452058:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579427.452151:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591693952 00000100:00100000:0.0:1787579427.452159:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591693952 00000100:00100000:0.0:1787579427.452226:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:0.0:1787579427.452236:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce831d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+37:2361:x1874412591693952:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579427.452250:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579427.452273:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7468 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d067 expref: 37 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.452291:0:5850:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0cea147d700) 00010000:00010000:0.0:1787579427.452296:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579427.452369:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce831d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+36:2361:x1874412591693952:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 134us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579427.452376:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:3.0:1787579427.461069:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579427.461432:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591694208 00000100:00100000:2.0:1787579427.461441:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591694208 00000100:00100000:2.0:1787579427.461497:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 99 00000100:00100000:2.0:1787579427.461506:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+36:10536:x1874412591694208:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1787579427.461528:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579427.461550:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b7476 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d06e expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.461653:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b747d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.461667:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b747d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.461702:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b747d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579427.461715:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787579427.461831:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b7476 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d06e expref: 39 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.461850:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b747d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d06e expref: 38 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.461859:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0cea147d700) 00010000:00010000:2.0:1787579427.461862:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787579427.461865:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319400, rc 0) 00000100:00100000:2.0:1787579427.464584:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+38:10536:x1874412591694208:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 3070us (3513us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1787579427.464596:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 99 00000100:00100000:1.0:1787579427.477848:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579427.478022:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591694336 00000100:00100000:3.0:1787579427.478032:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591694336 00000100:00100000:3.0:1787579427.478124:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 38 00000100:00100000:3.0:1787579427.478134:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+6:2361:x1874412591694336:12345-192.168.206.53@tcp:1:lfs.0 00010000:00010000:3.0:1787579427.478175:0:7660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b8f890d/0xb72beeaffa1b748b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.478205:0:7660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000082c9f210/0xb72beeaffa1b744c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d059 expref: 6 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.478213:0:7660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579427.478218:0:7660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787579427.478222:0:7660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b8f890d/0xb72beeaffa1b748b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.478258:0:7660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000082c9f210/0xb72beeaffa1b744c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d059 expref: 6 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.478272:0:7660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000082c9f210/0xb72beeaffa1b744c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d059 expref: 6 pid: 6711 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579427.478302:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7660:1874412616874624:192.168.206.53@tcp:104: 00000100:00100000:3.0:1787579427.478398:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce919d83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787579427.482161:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7660:1874412616874624:192.168.206.53@tcp:104: 00010000:00010000:1.0:1787579427.482201:0:7660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b8f890d/0xb72beeaffa1b748b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579427.485048:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579427.485131:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591694464 00000100:00100000:3.0:1787579427.485139:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591694464 00002000:00100000:3.0:1787579427.485323:0:6715:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffffa0ceba82f800 x1874412591694464/t0(0) o4->963d8c17-1326-491b-be60-9002b9296555@192.168.206.53@tcp:668/0 lens 504/0 e 0 to 0 dl 1787579438 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787579427.485333:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0ceba82f800 with x1874412591694464 ext(0->8) 00010000:00010000:3.0:1787579427.485343:0:6715:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000082c9f210/0xb72beeaffa1b744c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d059 expref: 7 pid: 6711 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.485358:0:6715:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000082c9f210/0xb72beeaffa1b744c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d059 expref: 7 pid: 6711 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787579427.485366:0:6715:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa0ceba82f800 00000100:00100000:3.0:1787579427.485399:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 1 00000100:00100000:3.0:1787579427.485409:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:963d8c17-1326-491b-be60-9002b9296555+7:2359:x1874412591694464:12345-192.168.206.53@tcp:4:lfs.0 00000100:00100000:3.0:1787579427.485889:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:963d8c17-1326-491b-be60-9002b9296555+9:2359:x1874412591694464:12345-192.168.206.53@tcp:4:lfs.0 Request processed in 480us (847us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787579427.485897:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 1 00002000:00100000:3.0:1787579427.485915:0:6715:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffffa0ceba82f800 x1874412591694464/t4294967302(0) o4->963d8c17-1326-491b-be60-9002b9296555@192.168.206.53@tcp:668/0 lens 504/448 e 0 to 0 dl 1787579438 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787579427.485953:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0ceba82f800 with x1874412591694464 ext(0->8) 00010000:00010000:3.0:1787579427.485961:0:6715:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000082c9f210/0xb72beeaffa1b744c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d059 expref: 9 pid: 6711 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.485980:0:6715:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000082c9f210/0xb72beeaffa1b744c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d059 expref: 9 pid: 6711 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787579427.485992:0:6715:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa0ceba82f800 00000100:00100000:3.0:1787579427.490332:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579427.494942:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591694592 00000100:00100000:1.0:1787579427.494953:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591694592 00010000:00010000:1.0:1787579427.494998:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000082c9f210/0xb72beeaffa1b744c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d059 expref: 9 pid: 6711 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579427.495037:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 50 00000100:00100000:1.0:1787579427.495045:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+9:2362:x1874412591694592:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787579427.495058:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787579427.495075:0:8477:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787579427.495079:0:8477:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787579426 00002000:00010000:1.0:1787579427.495081:0:8477:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787579426 00002000:00010000:1.0:1787579427.495083:0:8477:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787579426 00010000:00010000:1.0:1787579427.495089:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000082c9f210/0xb72beeaffa1b744c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d059 expref: 9 pid: 6711 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579427.495103:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000082c9f210/0xb72beeaffa1b744c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d059 expref: 9 pid: 6711 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579427.495122:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082c9f210/0xb72beeaffa1b744c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d059 expref: 9 pid: 6711 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579427.495137:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787579427.495151:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787579427.495158:0:8477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b8f890d/0xb72beeaffa1b748b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579427.495169:0:8477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b8f890d/0xb72beeaffa1b748b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579427.495201:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787579427.495252:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+8:2362:x1874412591694592:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 208us (4928us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579427.495259:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 50 00010000:00010000:3.0:1787579427.495658:0:7660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b8f890d/0xb72beeaffa1b748b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.495670:0:7660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b8f890d/0xb72beeaffa1b748b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.495693:0:7660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b8f890d/0xb72beeaffa1b748b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.495701:0:7660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b8f890d/0xb72beeaffa1b748b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.495709:0:7660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b8f890d/0xb72beeaffa1b748b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.495716:0:7660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8152f000 already unused, calling callback (ffffffffc1654230) 00010000:00010000:3.0:1787579427.495721:0:7660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b8f890d/0xb72beeaffa1b748b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.495729:0:7660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b8f890d/0xb72beeaffa1b748b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.495747:0:7660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b8f890d/0xb72beeaffa1b748b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.495755:0:7660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b8f890d/0xb72beeaffa1b748b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579427.495813:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+7:2361:x1874412591694336:12345-192.168.206.53@tcp:1:lfs.0 Request processed in 17679us (17972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579427.495820:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 38 00000100:00100000:3.0:1787579427.502222:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579427.503462:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591694848 00000100:00100000:2.0:1787579427.503475:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591694848 00000100:00100000:2.0:1787579427.503538:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 26 00000100:00100000:2.0:1787579427.503548:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce9c705050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+38:10536:x1874412591694848:12345-192.168.206.53@tcp:35:lfs.0 00000004:00010000:2.0:1787579427.503607:0:5870:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b747d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d06e expref: 38 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787579427.503858:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1787579427.503918:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1787579427.504342:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1787579427.504393:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7492 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.504415:0:5870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7437 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d04b expref: 42 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.504423:0:5870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7492 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.504453:0:5870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7437 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d04b expref: 42 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.504466:0:5870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7437 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d04b expref: 42 pid: 5866 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579427.504478:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1426d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5870:1874412616874752:192.168.206.53@tcp:104: 00000100:00100000:2.0:1787579427.504563:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceba43d180 going to sleep for 11 seconds 00000100:00100000:0.0:1787579427.510425:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579427.510505:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591694976 00000100:00100000:1.0:1787579427.510513:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591694976 00010000:00010000:1.0:1787579427.510551:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7437 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d04b expref: 43 pid: 5866 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579427.510590:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 51 00000100:00100000:1.0:1787579427.510600:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1abc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+43:2360:x1874412591694976:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787579427.510612:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787579427.510619:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7437 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d04b expref: 43 pid: 5866 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579427.510630:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7437 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d04b expref: 43 pid: 5866 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579427.510650:0:5850:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0cea147d700) 00010000:00010000:1.0:1787579427.510654:0:5850:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7492 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579427.510675:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7492 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579427.510682:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7492 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579427.510700:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787579427.510755:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1abc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+43:2360:x1874412591694976:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 156us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579427.510763:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 51 00010000:00010000:2.0:1787579427.511221:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7437 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d04b expref: 42 pid: 5866 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579427.511238:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1426d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5870:1874412616874752:192.168.206.53@tcp:104: 00010000:00010000:2.0:1787579427.511258:0:5870:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7492 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.511267:0:5870:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7492 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.511272:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7492 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787579427.511384:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1787579427.511571:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1787579427.511668:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1426d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5870:1874412616874880:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787579427.511717:0:5870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579427.511751:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceba43d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787579427.512811:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616874880 00000100:00100000:1.0:1787579427.512820:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616874880 00000100:00100000:1.0:1787579427.513089:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787579427.513099:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5870:x1874412616874880:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787579427.513195:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5870:x1874412616874880:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 98us (1477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579427.513203:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787579427.513288:0:5870:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1787579427.513294:0:5870:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:3.0:1787579427.513312:0:5870:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0ceb4695180, transno 4294967301 00000100:00100000:3.0:1787579427.513330:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1426d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5870:1874412616874880:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787579427.514180:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1787579427.514255:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce830ee680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5870:1874412616875008:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787579427.514310:0:5870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579427.514335:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce919d8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787579427.514354:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616875008 00000100:00100000:3.0:1787579427.514359:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616875008 00000100:00100000:3.0:1787579427.514382:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787579427.514389:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5870:x1874412616875008:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787579427.514514:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5870:x1874412616875008:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 125us (204us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787579427.514530:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787579427.514562:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce830ee680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5870:1874412616875008:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787579427.514605:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1787579427.514636:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7492 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.514645:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7492 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.514652:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7492 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.514658:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318a00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579427.514662:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7492 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.514670:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7492 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.514683:0:5870:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0cea147d700) 00010000:00010000:3.0:1787579427.514686:0:5870:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787579427.514690:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7492 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.514695:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7492 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787579427.514831:0:5870:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787579427.515341:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1787579427.515352:0:5870:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 363706424745ns, next at 364706422685ns, rc = 0 00000001:00080000:3.0:1787579427.515365:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1787579427.515398:0:5870:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0cea147d700) 00010000:00010000:3.0:1787579427.515401:0:5870:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787579427.515408:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b747d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d06e expref: 46 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579427.515500:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce9c705050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+45:10536:x1874412591694848:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 11953us (13286us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1787579427.515513:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 26 00000020:00080000:3.0:1787579427.515517:0:5870:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1787579427.515533:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787579427.519777:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579427.520733:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591695104 00000100:00100000:1.0:1787579427.520745:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591695104 00000100:00100000:1.0:1787579427.520851:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 100 00000100:00100000:1.0:1787579427.520862:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+45:10536:x1874412591695104:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1787579427.520884:0:9530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579427.521023:0:9530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b7499 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d075 expref: -99 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579427.521084:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b7499 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d075 expref: 46 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579427.521119:0:9530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b7499 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d075 expref: 46 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579427.521141:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:1.0:1787579427.521145:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787579427.521153:0:9530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb47c8600, rc 0) 00000100:00100000:1.0:1787579427.521253:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+46:10536:x1874412591695104:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 393us (1485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579427.521261:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 100 00000100:00100000:1.0:1787579427.524362:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579427.524596:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591695360 00000100:00100000:0.0:1787579427.524605:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591695360 00000100:00100000:0.0:1787579427.524654:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 27 00000100:00100000:0.0:1787579427.524662:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+46:10536:x1874412591695360:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:0.0:1787579427.525590:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+47:10536:x1874412591695360:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 925us (1278us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1787579427.525599:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 27 00000100:00100000:0.0:1787579427.591053:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579427.591216:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591695488 00000100:00100000:3.0:1787579427.591225:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591695488 00000100:00100000:3.0:1787579427.591282:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 101 00000100:00100000:3.0:1787579427.591293:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+47:10547:x1874412591695488:12345-192.168.206.53@tcp:34:lfs.0 00010000:00010000:3.0:1787579427.591361:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b74a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591376:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b74a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591387:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b74a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591401:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b74a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591408:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b74a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591414:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b74a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591514:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b74ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591522:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b74ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591529:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b74ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787579427.591565:0:9532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b74ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591576:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b74a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591581:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b74a0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591587:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b74a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591606:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8152f000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579427.591610:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b74a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591618:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b74a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591629:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:3.0:1787579427.591632:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579427.591637:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b74a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591649:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b74a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591663:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b74a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591670:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b74a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591675:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b74a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591681:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8152ea00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579427.591684:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b74a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591689:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b74a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591696:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0ce84d55b00) 00010000:00010000:3.0:1787579427.591698:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579427.591701:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b74a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591707:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b74a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591720:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b74ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591725:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b74ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591738:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b74ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591742:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8152e200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579427.591745:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b74ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591751:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b74ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591759:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:3.0:1787579427.591762:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579427.591764:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b74ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.591770:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b74ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579427.591844:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+47:10547:x1874412591695488:12345-192.168.206.53@tcp:34:lfs.0 Request processed in 552us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579427.591852:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 101 00000100:00100000:0.0:1787579427.644834:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579427.644970:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591695744 00000100:00100000:2.0:1787579427.644980:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591695744 00000100:00100000:2.0:1787579427.645036:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 102 00000100:00100000:2.0:1787579427.645046:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+47:10550:x1874412591695744:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1787579427.645064:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579427.645095:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b74b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d07c expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.645180:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b74bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.645201:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b74bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.645214:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b74bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.645230:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b74c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.645237:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b74c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.645244:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b74c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.645364:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b74ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.645386:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b74ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.645394:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b74ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579427.645404:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787579427.645493:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b74bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.645500:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b74bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.645506:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b74bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.645512:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba319e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579427.645516:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b74bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.645523:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b74bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.645534:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:2.0:1787579427.645537:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579427.645541:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b74bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.645547:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b74bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.645559:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b74c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.645571:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b74c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.645577:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b74c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.645582:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579427.645585:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b74c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.645591:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b74c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.645598:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0cea147d100) 00010000:00010000:2.0:1787579427.645601:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579427.645604:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b74c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.645609:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b74c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.645646:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b74b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d07c expref: 50 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.645659:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b74ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d07c expref: 49 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.645666:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:2.0:1787579427.645668:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787579427.645688:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319000, rc 0) 00000100:00100000:2.0:1787579427.645749:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+49:10550:x1874412591695744:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 704us (924us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1787579427.645756:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 102 00000100:00100000:1.0:1787579427.653076:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579427.653753:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591695872 00000100:00100000:2.0:1787579427.653764:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591695872 00000100:00100000:2.0:1787579427.653822:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 103 00000100:00100000:2.0:1787579427.653833:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+49:10550:x1874412591695872:12345-192.168.206.53@tcp:54:lfs.0 00010000:00010000:2.0:1787579427.654165:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b74d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.654182:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b74d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.654193:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b74d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.654218:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b74d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.654223:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b74d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.654229:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b74d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.654234:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318400 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579427.654239:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b74d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.654246:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b74d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.654272:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:2.0:1787579427.654275:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787579427.654279:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b74d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.654286:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b74d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579427.654418:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+49:10550:x1874412591695872:12345-192.168.206.53@tcp:54:lfs.0 Request processed in 585us (1348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579427.654426:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 103 00000100:00100000:0.0:1787579427.658556:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579427.658636:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591696128 00000100:00100000:3.0:1787579427.658646:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591696128 00000100:00100000:3.0:1787579427.658712:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 28 00000100:00100000:3.0:1787579427.658723:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+49:10550:x1874412591696128:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:3.0:1787579427.659753:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+50:10550:x1874412591696128:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 1028us (1201us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787579427.659764:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 28 00000100:00100000:0.0:1787579427.747866:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579427.748483:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591696384 00000100:00100000:2.0:1787579427.748494:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591696384 00000100:00100000:2.0:1787579427.748554:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 104 00000100:00100000:2.0:1787579427.748565:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+50:10560:x1874412591696384:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:2.0:1787579427.748588:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579427.748603:0:5867:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787579427.748628:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b745a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d060 expref: 50 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.748646:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:2.0:1787579427.748651:0:5867:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787579427.748663:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b74df lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d083 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.748748:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b74e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.748779:0:5867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b74ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d07c expref: 50 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.748788:0:5867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b74e6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.748817:0:5867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b74ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d07c expref: 50 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.748830:0:5867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b74ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d07c expref: 50 pid: 5868 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579427.748843:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1426300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5867:1874412616875136:192.168.206.53@tcp:104: 00000100:00100000:2.0:1787579427.748991:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceba43d000 going to sleep for 11 seconds 00000100:00100000:1.0:1787579427.755094:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579427.755296:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1426300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5867:1874412616875136:192.168.206.53@tcp:104: 00010000:00010000:3.0:1787579427.755320:0:5867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b74e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579427.755394:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591696512 00000100:00100000:0.0:1787579427.755401:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591696512 00010000:00010000:0.0:1787579427.755434:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b74ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d07c expref: 51 pid: 5868 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579427.755575:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 52 00000100:00100000:0.0:1787579427.755585:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:963d8c17-1326-491b-be60-9002b9296555+51:2360:x1874412591696512:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579427.755599:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579427.755606:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b74ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d07c expref: 51 pid: 5868 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.755636:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b74ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d07c expref: 51 pid: 5868 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.755657:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b74ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d07c expref: 51 pid: 5868 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.755672:0:5852:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:0.0:1787579427.755677:0:5852:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b74e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.755687:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b74e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.755693:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b74e6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.755756:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579427.755812:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:963d8c17-1326-491b-be60-9002b9296555+50:2360:x1874412591696512:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 229us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579427.755819:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 52 00010000:00010000:3.0:1787579427.756230:0:5867:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b74e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.756238:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b74e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579427.756256:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787579427.756689:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b74df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d083 expref: 51 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.756707:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b74e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d083 expref: 50 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.756714:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:3.0:1787579427.756717:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787579427.756720:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba318800, rc 0) 00000100:00100000:3.0:1787579427.756762:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+50:10560:x1874412591696384:12345-192.168.206.53@tcp:101:bash.0 Request processed in 8199us (8904us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1787579427.756769:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 104 00000100:00100000:1.0:1787579427.777404:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579427.777554:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591696768 00000100:00100000:0.0:1787579427.777564:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591696768 00000100:00100000:0.0:1787579427.777618:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 105 00000100:00100000:0.0:1787579427.777628:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+50:10560:x1874412591696768:12345-192.168.206.53@tcp:36:bash.0 00010000:00010000:0.0:1787579427.777859:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b74f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.777875:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b74f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.777898:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b74f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787579427.777982:0:5866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1787579427.778006:0:5866:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be415c7e reply state 00000000d0e93275 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b74f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579427.778015:0:5866:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787579427.778101:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+53:10560:x1874412591696768:12345-192.168.206.53@tcp:36:bash.0 Request processed in 474us (704us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1787579427.778108:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 105 00000020:00080000:0.0:1787579427.778113:0:5866:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787579427.780065:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b74f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.780079:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b74f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.780087:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b74f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.780093:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579427.780098:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b74f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.780105:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b74f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.780137:0:3305:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:2.0:1787579427.780140:0:3305:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579427.780144:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b74f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.780149:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b74f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579427.786712:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579427.786976:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591696896 00000100:00100000:3.0:1787579427.786985:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591696896 00000100:00100000:3.0:1787579427.787039:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 106 00000100:00100000:3.0:1787579427.787049:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+52:10560:x1874412591696896:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:3.0:1787579427.787070:0:9532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579427.787101:0:9532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b74fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d08a expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.787173:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7502 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.787187:0:9532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b74e6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d083 expref: 53 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.787196:0:9532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7502 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.787227:0:9532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b74e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d083 expref: 53 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.787241:0:9532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b74e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d083 expref: 53 pid: 5867 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579427.787253:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb3f19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9532:1874412616875264:192.168.206.53@tcp:104: 00000100:00100000:3.0:1787579427.787544:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce919d8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787579427.796576:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579427.796665:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591697024 00000100:00100000:2.0:1787579427.796674:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591697024 00010000:00010000:2.0:1787579427.796709:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b74e6 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d083 expref: 54 pid: 5867 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579427.796749:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 53 00000100:00100000:2.0:1787579427.796758:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1abf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+54:2360:x1874412591697024:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787579427.796772:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579427.796778:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b74e6 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d083 expref: 54 pid: 5867 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.796790:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b74e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d083 expref: 54 pid: 5867 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.796810:0:5850:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:2.0:1787579427.796816:0:5850:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7502 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.796825:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7502 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.796851:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7502 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.796867:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579427.796920:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1abf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+54:2360:x1874412591697024:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 163us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579427.796945:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 53 00010000:00010000:3.0:1787579427.797393:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b74e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d083 expref: 53 pid: 5867 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579427.797412:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb3f19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9532:1874412616875264:192.168.206.53@tcp:104: 00010000:00010000:3.0:1787579427.797432:0:9532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7502 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.797483:0:9532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7502 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.797503:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7502 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579427.797545:0:9532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787579427.797550:0:9532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787579427.797569:0:9532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7502 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.797598:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b74fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d08a expref: 53 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.797614:0:9532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7502 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d08a expref: 52 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.797622:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:3.0:1787579427.797624:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787579427.797628:0:9532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8152ea00, rc 0) 00000100:00100000:3.0:1787579427.797660:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+52:10560:x1874412591696896:12345-192.168.206.53@tcp:101:bash.0 Request processed in 10612us (10956us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579427.797668:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 106 00000100:00100000:1.0:1787579427.807592:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579427.808442:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591697280 00000100:00100000:0.0:1787579427.808453:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591697280 00000100:00100000:0.0:1787579427.808512:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 29 00000100:00100000:0.0:1787579427.808522:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+52:10560:x1874412591697280:12345-192.168.206.53@tcp:35:bash.0 00000100:00100000:0.0:1787579427.808745:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+53:10560:x1874412591697280:12345-192.168.206.53@tcp:35:bash.0 Request processed in 224us (1160us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1787579427.808753:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 29 00000100:00100000:1.0:1787579427.885308:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579427.885427:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591697408 00000100:00100000:3.0:1787579427.885437:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591697408 00000100:00100000:3.0:1787579427.885495:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 107 00000100:00100000:3.0:1787579427.885506:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+53:10566:x1874412591697408:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1787579427.885526:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579427.885545:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7509 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d091 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.885621:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7510 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.885635:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.885646:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579427.885713:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787579427.885717:0:5867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787579427.885750:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.885774:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7509 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d091 expref: 55 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.885792:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7510 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d091 expref: 54 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.885800:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:3.0:1787579427.885803:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787579427.885806:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8152f000, rc 0) 00000100:00100000:3.0:1787579427.885859:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+54:10566:x1874412591697408:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 355us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579427.885866:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 107 00000100:00100000:1.0:1787579427.890543:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579427.891353:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591697536 00000100:00100000:0.0:1787579427.891363:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591697536 00000100:00100000:0.0:1787579427.891417:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 108 00000100:00100000:0.0:1787579427.891446:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+54:10566:x1874412591697536:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1787579427.891465:0:5866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579427.891488:0:5866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7517 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d098 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.891563:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8c00/0xb72beeaffa1b751e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.891577:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8c00/0xb72beeaffa1b751e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.891587:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8c00/0xb72beeaffa1b751e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.891600:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7525 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.891607:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.891614:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.891702:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b752c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.891711:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b752c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.891718:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b752c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579427.891747:0:5866:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787579427.891751:0:5866:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787579427.891766:0:5866:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b752c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.891787:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b752c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.891795:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8c00/0xb72beeaffa1b751e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.891802:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8c00/0xb72beeaffa1b751e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.891808:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8c00/0xb72beeaffa1b751e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.891815:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8c00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579427.891819:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8c00/0xb72beeaffa1b751e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.891827:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8c00/0xb72beeaffa1b751e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.891836:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:0.0:1787579427.891839:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579427.891844:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8c00/0xb72beeaffa1b751e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.891850:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8c00/0xb72beeaffa1b751e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.891862:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.891868:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7525 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.891879:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7525 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.891885:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9600 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579427.891887:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7525 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.891894:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7525 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.891911:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0ce82cbbe00) 00010000:00010000:0.0:1787579427.891914:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579427.891917:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7525 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.891923:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7525 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.891987:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7517 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d098 expref: 56 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.892000:0:5866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b752c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d098 expref: 55 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.892007:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:0.0:1787579427.892009:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787579427.892012:0:5866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c9a00, rc 0) 00000100:00100000:0.0:1787579427.892061:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+55:10566:x1874412591697536:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 625us (1526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579427.892076:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 108 00000100:00100000:1.0:1787579427.896109:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579427.896159:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591697664 00000100:00100000:3.0:1787579427.896166:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591697664 00000100:00100000:0.0:1787579427.896278:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:0.0:1787579427.896291:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:963d8c17-1326-491b-be60-9002b9296555+55:2361:x1874412591697664:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579427.896305:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579427.896334:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b752c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d098 expref: 55 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.896351:0:5852:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:0.0:1787579427.896356:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579427.896400:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:963d8c17-1326-491b-be60-9002b9296555+54:2361:x1874412591697664:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 113us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579427.896408:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:2.0:1787579427.896517:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579427.896588:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591697920 00000100:00100000:3.0:1787579427.896593:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591697920 00000100:00100000:3.0:1787579427.896632:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 109 00000100:00100000:3.0:1787579427.896640:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+54:10566:x1874412591697920:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1787579427.897182:0:9532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579427.897197:0:9532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7533 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d09f expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.897398:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b753a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.897409:0:9532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7502 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d08a expref: 55 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.897414:0:9532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b753a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.897435:0:9532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7502 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d08a expref: 55 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.897444:0:9532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7502 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d08a expref: 55 pid: 9532 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579427.897453:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb3f19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9532:1874412616875392:192.168.206.53@tcp:104: 00000100:00100000:3.0:1787579427.897515:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce919d8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787579427.901218:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb3f19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9532:1874412616875392:192.168.206.53@tcp:104: 00010000:00010000:3.0:1787579427.901247:0:9532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b753a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579427.903923:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579427.904534:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591698048 00000100:00100000:2.0:1787579427.904543:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591698048 00010000:00010000:2.0:1787579427.904579:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7502 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d08a expref: 56 pid: 9532 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579427.904617:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 54 00000100:00100000:2.0:1787579427.904626:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+56:2360:x1874412591698048:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787579427.904639:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579427.904645:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7502 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d08a expref: 56 pid: 9532 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.904658:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7502 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d08a expref: 56 pid: 9532 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.904687:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ea00/0xb72beeaffa1b7502 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d08a expref: 56 pid: 9532 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.904702:0:5850:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:2.0:1787579427.904707:0:5850:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b753a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.904726:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b753a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.904734:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b753a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579427.904755:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579427.904803:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+55:2360:x1874412591698048:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 178us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579427.904810:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 54 00010000:00010000:3.0:1787579427.904994:0:9532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b753a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.905004:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b753a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579427.905022:0:9532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787579427.905143:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e200/0xb72beeaffa1b7533 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d09f expref: 56 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.905159:0:9532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b753a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d09f expref: 55 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.905167:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:3.0:1787579427.905170:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787579427.905172:0:9532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce8152ec00, rc 0) 00000100:00100000:3.0:1787579427.906250:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+55:10566:x1874412591697920:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 9608us (9729us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1787579427.906259:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 109 00000100:00100000:1.0:1787579427.910524:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579427.910583:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591698304 00000100:00100000:0.0:1787579427.910593:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591698304 00000100:00100000:0.0:1787579427.910653:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:0.0:1787579427.910664:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce831d5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:963d8c17-1326-491b-be60-9002b9296555+55:10566:x1874412591698304:12345-192.168.206.53@tcp:103:lfs.0 00010000:00010000:0.0:1787579427.910687:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579427.910709:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b7499 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d075 expref: 55 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579427.910727:0:5852:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:0.0:1787579427.910731:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579427.910782:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce831d5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:963d8c17-1326-491b-be60-9002b9296555+54:10566:x1874412591698304:12345-192.168.206.53@tcp:103:lfs.0 Request processed in 120us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579427.910790:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:2.0:1787579427.913055:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579427.913128:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591698432 00000100:00100000:3.0:1787579427.913136:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591698432 00000100:00100000:3.0:1787579427.913184:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 110 00000100:00100000:3.0:1787579427.913194:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+54:10566:x1874412591698432:12345-192.168.206.53@tcp:58:lfs.0 00010000:00010000:3.0:1787579427.913283:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b7548 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.913299:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b7548 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.913321:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b7548 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787579427.913564:0:5867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1787579427.913716:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+54:10566:x1874412591698432:12345-192.168.206.53@tcp:58:lfs.0 Request processed in 522us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579427.913724:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 110 00000100:00100000:1.0:1787579427.919885:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579427.920052:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591698560 00000100:00100000:3.0:1787579427.920062:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591698560 00000100:00100000:3.0:1787579427.920117:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 111 00000100:00100000:3.0:1787579427.920127:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+54:10566:x1874412591698560:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1787579427.920144:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579427.920163:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b754f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d0a6 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.920224:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b7548 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.920242:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b754f lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0a6 expref: 55 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.920260:0:5868:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b7548 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.920271:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b754f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0a6 expref: 55 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.920283:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:3.0:1787579427.920285:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787579427.920289:0:5868:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b754f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0a6 expref: 55 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579427.920310:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce813fca00, rc 0) 00000100:00100000:3.0:1787579427.920363:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+55:10566:x1874412591698560:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 238us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579427.920370:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 111 00010000:00010000:3.0:1787579428.256180:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787579428.384166:0:11712:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787579428.384175:0:11712:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787579428.384219:0:11712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1787579428.384227:0:11712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787579428.384341:0:11712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb3f19f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11712:1874412616875520:192.168.206.53@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787579428.384442:0:11712:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9816b840 going to sleep for 11 seconds 00000100:00100000:1.0:1787579428.388261:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579428.388382:0:11712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb3f19f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11712:1874412616875520:192.168.206.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787579428.388561:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591698688 00000100:00100000:0.0:1787579428.388568:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591698688 00000100:00100000:0.0:1787579428.388620:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 112 00000100:00100000:0.0:1787579428.388629:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+55:10567:x1874412591698688:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787579428.388657:0:9532:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787579428.388775:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+55:10567:x1874412591698688:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 Request processed in 146us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579428.388782:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 112 00000100:00100000:2.0:1787579428.391825:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579428.391949:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591698816 00000100:00100000:1.0:1787579428.391958:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591698816 00000100:00100000:1.0:1787579428.392008:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 113 00000100:00100000:1.0:1787579428.392018:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+55:10567:x1874412591698816:12345-192.168.206.53@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787579428.392082:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b7556 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392098:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b7556 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392109:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b7556 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392123:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b755d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392131:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b755d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392138:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b755d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392158:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9800/0xb72beeaffa1b7564 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392166:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9800/0xb72beeaffa1b7564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392173:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9800/0xb72beeaffa1b7564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787579428.392206:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787579428.392221:0:5867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787579428.392233:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9800/0xb72beeaffa1b7564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392244:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b7556 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392251:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b7556 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392258:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b7556 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392264:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c8000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579428.392268:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b7556 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392274:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b7556 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392286:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0ce84d55300) 00010000:00010000:1.0:1787579428.392289:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579428.392294:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b7556 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392299:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b7556 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392311:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b755d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392317:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b755d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392333:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b755d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392338:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c8600 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579428.392341:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b755d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392347:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b755d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392354:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffffa0ce86456900) 00010000:00010000:1.0:1787579428.392357:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579428.392360:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b755d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392366:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8600/0xb72beeaffa1b755d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392381:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9800/0xb72beeaffa1b7564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392386:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9800/0xb72beeaffa1b7564 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392391:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9800/0xb72beeaffa1b7564 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392395:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c9800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579428.392398:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9800/0xb72beeaffa1b7564 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392413:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9800/0xb72beeaffa1b7564 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392421:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:1.0:1787579428.392423:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579428.392426:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9800/0xb72beeaffa1b7564 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.392430:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9800/0xb72beeaffa1b7564 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579428.392513:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+55:10567:x1874412591698816:12345-192.168.206.53@tcp:34:lhsmtool_posix.0 Request processed in 496us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579428.392521:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 113 00000100:00100000:3.0:1787579428.394960:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579428.395058:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591699072 00000100:00100000:1.0:1787579428.395065:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591699072 00000100:00100000:1.0:1787579428.395109:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 114 00000100:00100000:1.0:1787579428.395119:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+55:10567:x1874412591699072:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787579428.395136:0:9530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579428.395153:0:9530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b756b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d0ad expref: -99 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.395232:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7572 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.395246:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.395256:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787579428.395276:0:9530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787579428.395368:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.395376:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7572 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.395382:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7572 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.395393:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c9c00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579428.395398:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7572 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.395404:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7572 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.395416:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:1.0:1787579428.395419:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787579428.395423:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7572 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.395429:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b7572 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.395463:0:9530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b756b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0ad expref: 57 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.395470:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0ce84d55300) 00010000:00010000:1.0:1787579428.395471:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787579428.395481:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b756b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0ad expref: 57 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.395488:0:9530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb47c9a00, rc 0) 00000100:00100000:1.0:1787579428.395569:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+56:10567:x1874412591699072:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 452us (642us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1787579428.395574:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 114 00000100:00100000:0.0:1787579428.397678:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579428.397791:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591699200 00000100:00100000:3.0:1787579428.397799:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591699200 00000100:00100000:3.0:1787579428.397879:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 115 00000100:00100000:3.0:1787579428.397889:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+56:10567:x1874412591699200:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787579428.397960:0:5866:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787579428.398042:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+56:10567:x1874412591699200:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 Request processed in 156us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579428.398048:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 115 00000100:00100000:2.0:1787579428.401193:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579428.401450:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591699456 00000100:00100000:3.0:1787579428.401459:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591699456 00000100:00100000:3.0:1787579428.401517:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 116 00000100:00100000:3.0:1787579428.401527:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+56:10567:x1874412591699456:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787579428.401558:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579428.401561:0:5868:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787579428.401587:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152f000/0xb72beeaffa1b7510 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d091 expref: 56 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.401604:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:3.0:1787579428.401609:0:5868:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787579428.401622:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a400/0xb72beeaffa1b7580 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d0b4 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787579428.402076:0:5868:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1787579428.402219:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b600/0xb72beeaffa1b7587 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.402233:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b600/0xb72beeaffa1b7587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.402242:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b600/0xb72beeaffa1b7587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.402407:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a400/0xb72beeaffa1b7580 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0b4 expref: 58 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.402423:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b600/0xb72beeaffa1b7587 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0b4 expref: 57 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.402431:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:3.0:1787579428.402433:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787579428.402443:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce90a8b600, rc 0) 00000100:00100000:3.0:1787579428.402496:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+57:10567:x1874412591699456:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 970us (1310us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1787579428.402503:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 116 00000100:00100000:2.0:1787579428.405733:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579428.405820:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591699712 00000100:00100000:1.0:1787579428.405829:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591699712 00000100:00100000:1.0:1787579428.405958:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 117 00000100:00100000:1.0:1787579428.406007:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+57:10567:x1874412591699712:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787579428.406055:0:9530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787579428.406076:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b600/0xb72beeaffa1b7587 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0b4 expref: 57 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.406088:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:1.0:1787579428.406094:0:9530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787579428.406108:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b7595 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.406117:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b7595 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.406122:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b7595 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.406406:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b759c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x269bac98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.406413:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b759c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x269bac98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.406429:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b759c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x269bac98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.406493:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b7595 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.406501:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b7595 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.406507:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b7595 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.406513:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c9a00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579428.406517:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b7595 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.406523:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b7595 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.406533:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:1.0:1787579428.406535:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579428.406539:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b7595 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.406544:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b7595 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.406553:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b759c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x269bac98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.406560:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b759c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x269bac98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.406572:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b759c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x269bac98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.406577:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c9c00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579428.406580:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b759c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x269bac98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.406586:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b759c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x269bac98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.406594:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x269bac98 (ffffa0ce86456900) 00010000:00010000:1.0:1787579428.406596:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579428.406599:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b759c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x269bac98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.406604:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9c00/0xb72beeaffa1b759c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x269bac98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579428.406681:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+56:10567:x1874412591699712:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 677us (956us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787579428.406688:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 117 00000100:00100000:0.0:1787579428.408842:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579428.408968:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591699840 00000100:00100000:3.0:1787579428.408977:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591699840 00000100:00100000:3.0:1787579428.409026:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 118 00000100:00100000:3.0:1787579428.409036:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+56:10567:x1874412591699840:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787579428.409052:0:5866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579428.409071:0:5866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b75a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d0bb expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.409103:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b75aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.409114:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b75aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.409124:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b75aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.409579:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b75a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0bb expref: 58 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.409593:0:5866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b75aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0bb expref: 57 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.409598:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0ce84d55400) 00010000:00010000:3.0:1787579428.409600:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787579428.409608:0:5866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce90a8b200, rc 0) 00000100:00100000:3.0:1787579428.409655:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+57:10567:x1874412591699840:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 621us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579428.409666:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 118 00000100:00100000:2.0:1787579428.413731:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579428.414280:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591700096 00000100:00100000:3.0:1787579428.414291:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591700096 00000100:00100000:3.0:1787579428.414349:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 119 00000100:00100000:3.0:1787579428.414359:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+57:10567:x1874412591700096:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787579428.414973:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a400/0xb72beeaffa1b75b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.414990:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a400/0xb72beeaffa1b75b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.415001:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a400/0xb72beeaffa1b75b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787579428.415377:0:5868:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1787579428.415387:0:5868:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 364606460044ns, next at 365606457655ns, rc = 0 00000004:00010000:3.0:1787579428.415533:0:5868:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d61824e reply state 0000000059e8476e transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a400/0xb72beeaffa1b75b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579428.415543:0:5868:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787579428.415638:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+59:10567:x1874412591700096:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 1278us (1914us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1787579428.415646:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 119 00000100:00100000:2.0:1787579428.417056:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00010000:00010000:1.0:1787579428.417159:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a400/0xb72beeaffa1b75b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.417170:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a400/0xb72beeaffa1b75b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.417177:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a400/0xb72beeaffa1b75b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579428.417197:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591700224 00010000:00010000:1.0:1787579428.417199:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8a400 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579428.417205:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a400/0xb72beeaffa1b75b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579428.417207:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591700224 00010000:00010000:1.0:1787579428.417216:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a400/0xb72beeaffa1b75b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.417231:0:3306:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0ce84d55400) 00010000:00010000:1.0:1787579428.417234:0:3306:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787579428.417238:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a400/0xb72beeaffa1b75b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.417243:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a400/0xb72beeaffa1b75b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579428.417307:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 120 00000100:00100000:3.0:1787579428.417317:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+58:10567:x1874412591700224:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787579428.417344:0:9530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579428.417359:0:9530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ae00/0xb72beeaffa1b75b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d0c2 expref: -99 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.417420:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ae00/0xb72beeaffa1b75b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0c2 expref: 59 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.417434:0:9530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ae00/0xb72beeaffa1b75b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0c2 expref: 59 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.417451:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0ce84d55400) 00010000:00010000:3.0:1787579428.417454:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787579428.417457:0:9530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce90a8ae00, rc 0) 00000100:00100000:3.0:1787579428.417503:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+59:10567:x1874412591700224:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 188us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579428.417571:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 120 00000100:00100000:0.0:1787579428.419135:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579428.419188:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591700352 00000100:00100000:2.0:1787579428.419196:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591700352 00000100:00080000:0.0:1787579428.419238:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787579428.419256:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 39 00000100:00100000:2.0:1787579428.419266:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1abe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+8:2360:x1874412591700352:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787579428.419712:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1abe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+9:2360:x1874412591700352:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 Request processed in 446us (580us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787579428.419721:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 39 00000100:00100000:2.0:1787579428.421720:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579428.422492:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591700608 00000100:00100000:0.0:1787579428.422502:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591700608 00000100:00100000:0.0:1787579428.422560:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 30 00000100:00100000:0.0:1787579428.422731:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+59:10567:x1874412591700608:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787579428.423012:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+60:10567:x1874412591700608:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 Request processed in 442us (1296us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1787579428.423021:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 30 00000100:00100000:3.0:1787579428.426168:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579428.426469:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591700864 00000100:00100000:2.0:1787579428.426477:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591700864 00000100:00100000:2.0:1787579428.426527:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 121 00000100:00100000:2.0:1787579428.426589:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+60:10567:x1874412591700864:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787579428.426690:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+60:10567:x1874412591700864:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 104us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579428.426697:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 121 00000100:00100000:1.0:1787579428.430807:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579428.432165:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591700992 00000100:00100000:3.0:1787579428.432194:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591700992 00000100:00100000:2.0:1787579428.432300:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 122 00000100:00100000:2.0:1787579428.432311:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+60:10567:x1874412591700992:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787579428.432345:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579428.432365:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b75bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d0c9 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.432430:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b75c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.432452:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b75c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.432465:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b75c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579428.432503:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787579428.432783:0:5868:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b75c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.432811:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b75bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0c9 expref: 62 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.432828:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b75c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0c9 expref: 61 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.432870:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0ce84d55400) 00010000:00010000:2.0:1787579428.432879:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787579428.432883:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba318e00, rc 0) 00000100:00100000:2.0:1787579428.432994:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+61:10567:x1874412591700992:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 683us (2193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579428.433001:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 122 00000100:00100000:1.0:1787579428.437609:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579428.437775:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591701120 00000100:00100000:2.0:1787579428.437784:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591701120 00000100:00100000:2.0:1787579428.437841:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 40 00000100:00100000:2.0:1787579428.437851:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+9:2360:x1874412591701120:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787579428.439044:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579428.440124:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003e5faec/0xb72beeaffa1b75cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d0d0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787579428.440152:0:6712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c4c23, blocks: 0x1 00010000:00010000:2.0:1787579428.440170:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=364s v=(0 0) 00010000:00010000:2.0:1787579428.440226:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579428.440239:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003e5faec/0xb72beeaffa1b75cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0d0 expref: 10 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.440257:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000003e5faec/0xb72beeaffa1b75cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0d0 expref: 10 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.440270:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319e00, rc 0) 00000100:00100000:2.0:1787579428.440415:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+10:2360:x1874412591701120:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 2562us (2810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579428.440424:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 40 00000100:00100000:3.0:1787579428.445344:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579428.445571:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591701376 00000100:00100000:1.0:1787579428.445582:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591701376 00000100:00100000:1.0:1787579428.445639:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 123 00000100:00100000:1.0:1787579428.445649:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+61:10567:x1874412591701376:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787579428.446199:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+61:10567:x1874412591701376:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 549us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579428.446207:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 123 00000100:00100000:1.0:1787579428.450145:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579428.450236:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591701504 00000100:00100000:3.0:1787579428.450245:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591701504 00000100:00100000:3.0:1787579428.450384:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 41 00000100:00100000:3.0:1787579428.450395:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+10:10567:x1874412591701504:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787579428.450411:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579428.450427:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050e095b3/0xb72beeaffa1b75d4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d0d7 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.450475:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000003e5faec/0xb72beeaffa1b75cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0d0 expref: 11 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.450484:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579428.450489:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579428.450494:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050e095b3/0xb72beeaffa1b75d4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0d7 expref: 11 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.450527:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000003e5faec/0xb72beeaffa1b75cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0d0 expref: 11 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.450540:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000003e5faec/0xb72beeaffa1b75cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0d0 expref: 11 pid: 6712 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579428.450554:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb3f1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6711:1874412616875648:192.168.206.53@tcp:104: 00000100:00100000:3.0:1787579428.450645:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce87c05540 going to sleep for 11 seconds 00000100:00100000:0.0:1787579428.453536:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb3f1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6711:1874412616875648:192.168.206.53@tcp:104: 00010000:00010000:0.0:1787579428.453567:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000050e095b3/0xb72beeaffa1b75d4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0d7 expref: 11 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.453585:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce90a8a600, rc 0) 00000100:00100000:0.0:1787579428.453632:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+11:10567:x1874412591701504:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 3240us (3496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579428.453655:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 41 00000100:00100000:3.0:1787579428.456527:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579428.457147:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591701632 00000100:00100000:2.0:1787579428.457157:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591701632 00010000:00010000:2.0:1787579428.457195:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000003e5faec/0xb72beeaffa1b75cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0d0 expref: 11 pid: 6712 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579428.457237:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 55 00000100:00100000:2.0:1787579428.457247:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3f19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+11:2359:x1874412591701632:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787579428.457261:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579428.457282:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000003e5faec/0xb72beeaffa1b75cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0d0 expref: 11 pid: 6712 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.457295:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000003e5faec/0xb72beeaffa1b75cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0d0 expref: 11 pid: 6712 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.457331:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003e5faec/0xb72beeaffa1b75cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0d0 expref: 11 pid: 6712 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.457347:0:5850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579428.457351:0:5850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579428.457358:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000050e095b3/0xb72beeaffa1b75d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0d7 expref: 10 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.457367:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050e095b3/0xb72beeaffa1b75d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0d7 expref: 10 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.457416:0:5850:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000050e095b3/0xb72beeaffa1b75d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0d7 expref: 10 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579428.457429:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1426a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5850:1874412616875776:192.168.206.53@tcp:105: 00000100:00100000:2.0:1787579428.457501:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceba43d840 going to sleep for 11 seconds 00000100:00100000:2.0:1787579428.460806:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1426a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5850:1874412616875776:192.168.206.53@tcp:105: 00010000:00010000:2.0:1787579428.460828:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579428.460995:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3f19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+10:2359:x1874412591701632:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 3748us (4473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579428.461006:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 55 00000100:00100000:3.0:1787579428.463447:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579428.464283:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591701760 00000100:00100000:2.0:1787579428.464294:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591701760 00002000:00100000:2.0:1787579428.464405:0:6717:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffffa0ceb3f1a300 x1874412591701760/t0(0) o4->963d8c17-1326-491b-be60-9002b9296555@192.168.206.53@tcp:669/0 lens 504/0 e 0 to 0 dl 1787579439 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787579428.464417:0:6717:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0ceb3f1a300 with x1874412591701760 ext(0->12) 00002000:00010000:2.0:1787579428.464423:0:6717:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0ceb3f1a300 00000100:00100000:2.0:1787579428.464494:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 3 00000100:00100000:2.0:1787579428.464506:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:963d8c17-1326-491b-be60-9002b9296555+10:2359:x1874412591701760:12345-192.168.206.53@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787579428.464989:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:963d8c17-1326-491b-be60-9002b9296555+12:2359:x1874412591701760:12345-192.168.206.53@tcp:4:lhsmtool_posix.0 Request processed in 484us (1551us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787579428.464997:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 3 00002000:00100000:2.0:1787579428.465004:0:6717:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffffa0ceb3f1a300 x1874412591701760/t4294967309(0) o4->963d8c17-1326-491b-be60-9002b9296555@192.168.206.53@tcp:669/0 lens 504/448 e 0 to 0 dl 1787579439 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787579428.465024:0:6717:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0ceb3f1a300 with x1874412591701760 ext(0->12) 00002000:00010000:2.0:1787579428.465028:0:6717:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0ceb3f1a300 00000100:00100000:3.0:1787579428.468348:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579428.468522:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591701888 00000100:00100000:2.0:1787579428.468530:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591701888 00000100:00100000:2.0:1787579428.468585:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 124 00000100:00100000:2.0:1787579428.468596:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+61:10567:x1874412591701888:12345-192.168.206.53@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787579428.511164:0:5888:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1787579428.511190:0:5888:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787579428.511225:0:5888:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1787579428.511277:0:5888:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0ceba1e0c00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1787579428.511281:0:5888:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0cebf802300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0ceba1e0000 00000020:00080000:1.0:1787579428.511285:0:5888:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0cebf802c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0cebf23b000 00000004:00080000:1.0:1787579428.511294:0:5888:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:1.0:1787579428.511305:0:5888:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1787579428.511317:0:5888:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0ce919d8540 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1787579428.511320:0:5888:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0ce8503da00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0ce919d86c0 00000020:00080000:1.0:1787579428.511322:0:5888:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0ce8503d600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0ce92001c00 00000020:00080000:1.0:1787579428.511343:0:5899:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1787579428.511533:0:5899:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1787579428.511640:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebf2f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616875904:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787579428.511715:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579428.511789:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616875904 00000100:00100000:1.0:1787579428.511795:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616875904 00000100:00100000:1.0:1787579428.512025:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787579428.512035:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf2f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3320:x1874412616875904:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787579428.512057:0:7660:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1787579428.512087:0:7660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8c4c22, atime: 0x6a8c4c22, ctime: 0x6a8c4c22, blocks: 0x1 00010000:00010000:1.0:1787579428.512095:0:7660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1a6ad73/0xb72beeaffa1b75db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.512109:0:7660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=364s v=(0 0) 00010000:00010000:1.0:1787579428.512114:0:7660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579428.512119:0:7660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1a6ad73/0xb72beeaffa1b75db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.512145:0:7660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1a6ad73/0xb72beeaffa1b75db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.512154:0:7660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1a6ad73/0xb72beeaffa1b75db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.512161:0:7660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1a6ad73/0xb72beeaffa1b75db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.512177:0:7660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787579428.512568:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+15:10567:x1874412591701888:12345-192.168.206.53@tcp:44:lhsmtool_posix.0 Request processed in 43971us (44224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579428.512577:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 124 00010000:00010000:0.0:1787579428.513108:0:5853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787579428.513115:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1a6ad73/0xb72beeaffa1b75db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.513124:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c8e00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:0.0:1787579428.513128:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1a6ad73/0xb72beeaffa1b75db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.513136:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1a6ad73/0xb72beeaffa1b75db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.513152:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1a6ad73/0xb72beeaffa1b75db lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.513159:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1a6ad73/0xb72beeaffa1b75db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.513176:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579428.513178:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579428.513179:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579428.513228:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616876032:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787579428.513266:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579428.513305:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787579428.513311:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616876160:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787579428.513331:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579428.513481:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616876032 00000100:00100000:0.0:1787579428.513486:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616876032 00000100:00100000:0.0:1787579428.513516:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616876160 00000100:00100000:0.0:1787579428.513519:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616876160 00000100:00100000:0.0:1787579428.513530:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787579428.513536:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1426a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3321:x1874412616876032:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787579428.513558:0:6710:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1787579428.513574:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003640667c/0xb72beeaffa1b75e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.513588:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000524d8183/0xb72beeaffa1b739d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d036 expref: 11 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.513595:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787579428.513599:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787579428.513602:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003640667c/0xb72beeaffa1b75e2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.513626:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000524d8183/0xb72beeaffa1b739d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d036 expref: 11 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.513639:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000524d8183/0xb72beeaffa1b739d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d036 expref: 11 pid: 6712 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579428.513650:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1abca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6710:1874412616876288:192.168.206.53@tcp:104: 00000100:00100000:1.0:1787579428.513723:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf2f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3320:x1874412616875904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1689us (2008us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787579428.513731:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787579428.513745:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787579428.513751:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3321:x1874412616876160:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787579428.513859:0:7660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787579428.513863:0:7660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787579427 00002000:00010000:1.0:1787579428.513866:0:7660:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787579428.513868:0:7660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787579427 -> 1787579427 00002000:00010000:1.0:1787579428.513870:0:7660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787579428.514142:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d11de40 going to sleep for 11 seconds 00000100:00080000:0.0:1787579428.514159:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1787579428.514262:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0cebf2f0a80/2, rc 0, transno 4294967304 00000100:00100000:2.0:1787579428.514269:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebf2f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616875904:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787579428.514367:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3321:x1874412616876160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 616us (1034us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787579428.514375:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787579428.518732:0:3321:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1787579428.518744:0:3321:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:2.0:1787579428.518778:0:3321:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffffa0cec1abd880 x1874412616876160/t4294967310(4294967310) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787579444 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787579428.518789:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0cec1abd880/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787579428.518795:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616876160:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787579428.521840:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579428.523556:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1abca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6710:1874412616876288:192.168.206.53@tcp:104: 00010000:00010000:3.0:1787579428.523583:0:6710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003640667c/0xb72beeaffa1b75e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579428.523998:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579428.524111:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591702144 00000100:00100000:3.0:1787579428.524129:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591702144 00000100:00100000:1.0:1787579428.524152:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591702016 00000100:00100000:1.0:1787579428.524161:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591702016 00000100:00100000:3.0:1787579428.524177:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 45 00000100:00100000:3.0:1787579428.524185:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba18f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+13:2359:x1874412591702144:12345-192.168.206.53@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1787579428.524190:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000524d8183/0xb72beeaffa1b739d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d036 expref: 13 pid: 6712 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579428.524215:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 56 00000100:00100000:1.0:1787579428.524222:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1426300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:963d8c17-1326-491b-be60-9002b9296555+13:2359:x1874412591702016:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787579428.524231:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787579428.524236:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000524d8183/0xb72beeaffa1b739d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d036 expref: 13 pid: 6712 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.524250:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000524d8183/0xb72beeaffa1b739d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d036 expref: 13 pid: 6712 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.524272:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000524d8183/0xb72beeaffa1b739d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d036 expref: 13 pid: 6712 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.524287:0:5852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787579428.524291:0:5852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787579428.524296:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003640667c/0xb72beeaffa1b75e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.524304:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003640667c/0xb72beeaffa1b75e2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579428.524336:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787579428.524380:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1426300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:963d8c17-1326-491b-be60-9002b9296555+12:2359:x1874412591702016:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 158us (2545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579428.524398:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 56 00010000:00010000:2.0:1787579428.525827:0:6710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003640667c/0xb72beeaffa1b75e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.525858:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003640667c/0xb72beeaffa1b75e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.525868:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003640667c/0xb72beeaffa1b75e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.525875:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003640667c/0xb72beeaffa1b75e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.525912:0:6710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787579428.526585:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787579428.526592:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003640667c/0xb72beeaffa1b75e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.526601:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9c00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:3.0:1787579428.526605:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003640667c/0xb72beeaffa1b75e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.526613:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003640667c/0xb72beeaffa1b75e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.526629:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003640667c/0xb72beeaffa1b75e2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.526636:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003640667c/0xb72beeaffa1b75e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.526661:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579428.526663:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579428.526664:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579428.529031:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1426a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3321:x1874412616876032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15486us (15755us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787579428.529045:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:3.0:1787579428.530440:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0cec1abce00/2, rc 0, transno 4294967311 00000100:00100000:3.0:1787579428.530450:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616876032:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1787579428.558665:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1787579428.558684:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:0.0:1787579428.558752:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba18f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+6:2359:x1874412591702144:12345-192.168.206.53@tcp:16:lhsmtool_posix.0 Request processed in 34562us (34750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579428.558763:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 45 00000100:00100000:1.0:1787579428.565506:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579428.565624:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591702400 00000100:00100000:2.0:1787579428.565637:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591702400 00000100:00100000:2.0:1787579428.565803:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 125 00000100:00100000:2.0:1787579428.565815:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+15:10567:x1874412591702400:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787579428.565893:0:5868:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579428.565978:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b75c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0c9 expref: 15 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.566010:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0ce84d55400) 00010000:00010000:2.0:1787579428.566016:0:5868:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787579428.566071:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b75e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.566087:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b75e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.566097:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b75e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787579428.566404:0:5868:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0876593 reply state 000000006296bc6a transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b75e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579428.566415:0:5868:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787579428.566533:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+16:10567:x1874412591702400:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 719us (1041us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1787579428.566541:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 125 00010000:00010000:0.0:1787579428.571542:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b75e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.571578:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b75e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.571586:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b75e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.571592:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318400 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579428.571596:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b75e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.571604:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b75e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.571620:0:3305:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0ce84d55400) 00010000:00010000:0.0:1787579428.571623:0:3305:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579428.571627:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b75e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.571633:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b75e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579428.574691:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579428.575439:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591702528 00000100:00100000:2.0:1787579428.575452:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591702528 00000100:00100000:0.0:1787579428.575619:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 46 00000100:00100000:0.0:1787579428.575631:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3f1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+6:2360:x1874412591702528:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787579428.576343:0:7660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787579428.576348:0:7660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787579427 -> 1787579427 00002000:00010000:0.0:1787579428.576350:0:7660:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787579426 00002000:00010000:0.0:1787579428.576353:0:7660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787579427 -> 1787579427 00002000:00010000:0.0:1787579428.576355:0:7660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787579428.576442:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3f1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+7:2360:x1874412591702528:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 Request processed in 811us (1769us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787579428.576470:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 46 00000100:00100000:1.0:1787579428.579616:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579428.580515:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591702784 00000100:00100000:3.0:1787579428.580547:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591702784 00000100:00100000:0.0:1787579428.580802:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 126 00000100:00100000:0.0:1787579428.580944:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf2f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+15:10567:x1874412591702784:12345-192.168.206.53@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787579428.581099:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b75f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.581117:0:9530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b75aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0bb expref: 15 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.581128:0:9530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b75f0 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.581168:0:9530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b75aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0bb expref: 15 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.581182:0:9530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b75aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0bb expref: 15 pid: 5866 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579428.581198:0:9530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1abe680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9530:1874412616876416:192.168.206.53@tcp:104: 00000100:00100000:0.0:1787579428.581461:0:9530:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cec1bcb600 going to sleep for 11 seconds 00000100:00100000:1.0:1787579428.584857:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579428.585193:0:9530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1abe680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9530:1874412616876416:192.168.206.53@tcp:104: 00010000:00010000:0.0:1787579428.585227:0:9530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b75f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579428.585401:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591702912 00000100:00100000:3.0:1787579428.585409:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591702912 00010000:00010000:3.0:1787579428.585455:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b75aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0bb expref: 16 pid: 5866 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579428.585556:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 57 00000100:00100000:3.0:1787579428.585567:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+16:2360:x1874412591702912:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787579428.585586:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579428.585594:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b75aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0bb expref: 16 pid: 5866 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.585607:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b75aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0bb expref: 16 pid: 5866 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.585632:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b75aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0bb expref: 16 pid: 5866 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.585650:0:5851:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0ce84d55400) 00010000:00010000:3.0:1787579428.585656:0:5851:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b75f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.585666:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b75f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.585685:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b75f0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.585714:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579428.585780:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+15:2360:x1874412591702912:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 214us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579428.585805:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 57 00010000:00010000:0.0:1787579428.585867:0:9530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b75f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.585893:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b75f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.585958:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b75f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.585967:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b75f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.585974:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b75f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.585981:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579428.585986:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b75f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.585995:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b75f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.586005:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0ce84d55400) 00010000:00010000:0.0:1787579428.586007:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787579428.586011:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b75f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.586017:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b75f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579428.586061:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf2f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+14:10567:x1874412591702784:12345-192.168.206.53@tcp:55:lhsmtool_posix.0 Request processed in 5249us (6458us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787579428.586069:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 126 00000100:00100000:0.0:1787579428.590023:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579428.590324:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591703040 00000100:00100000:2.0:1787579428.590337:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591703040 00000100:00100000:2.0:1787579428.590407:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 47 00000100:00100000:2.0:1787579428.590418:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1abe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+7:2360:x1874412591703040:12345-192.168.206.53@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787579428.590475:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a33515fc/0xb72beeaffa1b75f7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.590499:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000050e095b3/0xb72beeaffa1b75d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0d7 expref: 7 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.590508:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579428.590513:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787579428.590535:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a33515fc/0xb72beeaffa1b75f7 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.590582:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000050e095b3/0xb72beeaffa1b75d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0d7 expref: 7 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.590610:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000050e095b3/0xb72beeaffa1b75d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0d7 expref: 7 pid: 6711 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579428.590628:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1424700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6710:1874412616876544:192.168.206.53@tcp:104: 00000100:00100000:2.0:1787579428.590741:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceba43d600 going to sleep for 11 seconds 00000100:00100000:2.0:1787579428.594465:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1424700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6710:1874412616876544:192.168.206.53@tcp:104: 00010000:00010000:2.0:1787579428.594507:0:6710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a33515fc/0xb72beeaffa1b75f7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579428.596563:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579428.597057:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591703168 00000100:00100000:2.0:1787579428.597070:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591703168 00010000:00010000:2.0:1787579428.597113:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000050e095b3/0xb72beeaffa1b75d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0d7 expref: 8 pid: 6711 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579428.597159:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 58 00000100:00100000:2.0:1787579428.597168:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1abf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+8:2359:x1874412591703168:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787579428.597185:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579428.597211:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000050e095b3/0xb72beeaffa1b75d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0d7 expref: 8 pid: 6711 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.597247:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000050e095b3/0xb72beeaffa1b75d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0d7 expref: 8 pid: 6711 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.597284:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050e095b3/0xb72beeaffa1b75d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0d7 expref: 8 pid: 6711 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.597305:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787579428.597311:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787579428.597317:0:8477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a33515fc/0xb72beeaffa1b75f7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.597327:0:8477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a33515fc/0xb72beeaffa1b75f7 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.597363:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579428.597433:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1abf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+7:2359:x1874412591703168:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 265us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579428.597441:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 58 00010000:00010000:3.0:1787579428.597688:0:6710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a33515fc/0xb72beeaffa1b75f7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.597700:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a33515fc/0xb72beeaffa1b75f7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.597729:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a33515fc/0xb72beeaffa1b75f7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.597738:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a33515fc/0xb72beeaffa1b75f7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.597746:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a33515fc/0xb72beeaffa1b75f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.597753:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318e00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:3.0:1787579428.597758:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a33515fc/0xb72beeaffa1b75f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.597767:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a33515fc/0xb72beeaffa1b75f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.597779:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a33515fc/0xb72beeaffa1b75f7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.597799:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a33515fc/0xb72beeaffa1b75f7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579428.597861:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1abe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+6:2360:x1874412591703040:12345-192.168.206.53@tcp:1:lhsmtool_posix.0 Request processed in 7444us (7850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579428.597870:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 47 00000100:00100000:0.0:1787579428.601393:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579428.601488:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591703424 00000100:00100000:2.0:1787579428.601502:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591703424 00000100:00100000:2.0:1787579428.601575:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 127 00000100:00100000:2.0:1787579428.601585:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+14:10567:x1874412591703424:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787579428.601697:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b75fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.601716:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b75fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.601743:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b75fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.602326:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7605 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.602341:0:5866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ae00/0xb72beeaffa1b75b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0c2 expref: 15 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.602351:0:5866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7605 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.602392:0:5866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ae00/0xb72beeaffa1b75b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0c2 expref: 15 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.602408:0:5866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ae00/0xb72beeaffa1b75b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0c2 expref: 15 pid: 9530 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579428.602424:0:5866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1424700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5866:1874412616876672:192.168.206.53@tcp:104: 00000100:00100000:2.0:1787579428.602511:0:5866:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceba43d600 going to sleep for 11 seconds 00000100:00100000:2.0:1787579428.605483:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579428.605765:0:5866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1424700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5866:1874412616876672:192.168.206.53@tcp:104: 00010000:00010000:3.0:1787579428.605797:0:5866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7605 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579428.606366:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591703552 00000100:00100000:1.0:1787579428.606376:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591703552 00010000:00010000:0.0:1787579428.606528:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ae00/0xb72beeaffa1b75b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0c2 expref: 16 pid: 9530 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579428.606608:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 59 00000100:00100000:0.0:1787579428.606620:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1426d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+16:2360:x1874412591703552:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579428.606637:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579428.606656:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ae00/0xb72beeaffa1b75b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0c2 expref: 16 pid: 9530 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.606677:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ae00/0xb72beeaffa1b75b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0c2 expref: 16 pid: 9530 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.606702:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ae00/0xb72beeaffa1b75b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0c2 expref: 16 pid: 9530 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.606723:0:5850:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0ce84d55400) 00010000:00010000:0.0:1787579428.606729:0:5850:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7605 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.606739:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7605 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.606746:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7605 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.606780:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787579428.607224:0:5866:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7605 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.607234:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7605 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787579428.607470:0:5866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1787579428.607681:0:5866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1787579428.607742:0:5866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1787579428.607857:0:5866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1425f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5866:1874412616876800:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787579428.608070:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1426d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+18:2360:x1874412591703552:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 1448us (2595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579428.608082:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 59 00000100:00100000:2.0:1787579428.608162:0:5866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579428.608211:0:5866:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceba43dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787579428.608679:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616876800 00000100:00100000:3.0:1787579428.608689:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616876800 00000100:00100000:3.0:1787579428.608745:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787579428.608756:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5866:x1874412616876800:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787579428.608868:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5866:x1874412616876800:12345-0@lo:1000:mdt00_000.0 Request processed in 114us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579428.609119:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787579428.609250:0:5866:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1787579428.609258:0:5866:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0cec1abd880, transno 4294967310 00000100:00100000:2.0:1787579428.609278:0:5866:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffffa0cec1abce00 x1874412616876032/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787579444 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579428.609292:0:5866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1425f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5866:1874412616876800:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787579428.610592:0:5866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1787579428.610759:0:5866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1425f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5866:1874412616876928:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787579428.610832:0:5866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579428.611174:0:5866:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceba43d000 going to sleep for 11 seconds 00000100:00100000:3.0:1787579428.613274:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616876928 00000100:00100000:3.0:1787579428.613294:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616876928 00000100:00100000:2.0:1787579428.613517:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787579428.613529:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5866:x1874412616876928:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787579428.614072:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5866:x1874412616876928:12345-0@lo:1000:mdt00_000.0 Request processed in 543us (3237us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787579428.614082:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787579428.614373:0:5866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1425f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5866:1874412616876928:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1787579428.614489:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7605 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.614502:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7605 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.614511:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7605 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.614517:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318a00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579428.614523:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7605 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.614531:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7605 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.614550:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0ce84d55400) 00010000:00010000:0.0:1787579428.614553:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787579428.614559:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7605 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.614565:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7605 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.614601:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b7548 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.614607:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b7548 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.614629:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b7548 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.614635:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce813fde00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579428.614638:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b7548 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.614645:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b7548 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.614654:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:0.0:1787579428.614656:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787579428.614664:0:5866:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b754f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0a6 expref: 18 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.614760:0:5866:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b754f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0a6 expref: 18 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.614770:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b754f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0a6 expref: 18 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.614812:0:5866:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b754f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0a6 expref: 18 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579428.614828:0:5866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1abd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5866:1874412616877056:192.168.206.53@tcp:105: 00000100:00100000:0.0:1787579428.616026:0:5866:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cec1bcb600 going to sleep for 11 seconds 00000100:00100000:2.0:1787579428.619888:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579428.620043:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591703680 00000100:00100000:3.0:1787579428.620055:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591703680 00000100:00100000:3.0:1787579428.620126:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 31 00000100:00100000:3.0:1787579428.620138:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+19:10566:x1874412591703680:12345-192.168.206.53@tcp:49:lfs.0 00000100:00100000:3.0:1787579428.620300:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+19:10566:x1874412591703680:12345-192.168.206.53@tcp:49:lfs.0 Request processed in 164us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579428.620324:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 31 00000100:00100000:0.0:1787579428.622262:0:5866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1abd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5866:1874412616877056:192.168.206.53@tcp:105: 00010000:00010000:0.0:1787579428.622320:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b7548 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.622332:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fde00/0xb72beeaffa1b7548 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.622370:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b760c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.622385:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b760c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.622398:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b760c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.622409:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b760c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.622416:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b760c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.622423:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b760c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.622429:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579428.622433:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b760c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.622440:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b760c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.622451:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:0.0:1787579428.622454:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579428.622463:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b760c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.622470:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b760c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.622482:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b75fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.622488:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b75fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.622494:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b75fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.622499:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba319400 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579428.622502:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b75fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.622508:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b75fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.622514:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:0.0:1787579428.622517:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787579428.622519:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b75fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.622525:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b75fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579428.622787:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+18:10567:x1874412591703424:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 21201us (21406us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1787579428.622797:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 127 00000020:00080000:0.0:1787579428.622809:0:5866:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787579428.623615:0:11712:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787579428.623624:0:11712:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787579428.624434:0:11712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787579428.624446:0:11712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787579428.626646:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579428.626741:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579428.626868:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591704192 00000100:00100000:3.0:1787579428.626888:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591704192 00000100:00100000:3.0:1787579428.627003:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 32 00000100:00100000:3.0:1787579428.627015:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce9c704450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+18:10567:x1874412591704192:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787579428.627917:0:5870:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:0.0:1787579428.628035:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591703936 00000100:00100000:0.0:1787579428.628043:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591703936 00000001:00080000:3.0:1787579428.628121:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1787579428.628178:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b7613 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.628198:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b7613 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579428.628199:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 128 00010000:00010000:3.0:1787579428.628215:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b7613 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579428.628222:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+21:10566:x1874412591703936:12345-192.168.206.53@tcp:58:lfs.0 00010000:00010000:3.0:1787579428.628228:0:5870:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b7613 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.628234:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b7613 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.628241:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b7613 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579428.628297:0:5870:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787579428.628409:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce9c704450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+21:10567:x1874412591704192:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 Request processed in 1395us (1666us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1787579428.628419:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 32 00000020:00080000:3.0:1787579428.628424:0:5870:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787579428.628514:0:8475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787579428.628523:0:8475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b7613 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.628530:0:8475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8b200 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579428.628535:0:8475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b7613 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.628549:0:8475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b7613 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.628564:0:8475:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0ce84d55800) 00010000:00010000:2.0:1787579428.628568:0:8475:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787579428.628573:0:8475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b7613 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.628579:0:8475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b7613 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.628596:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579428.628598:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579428.628600:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787579428.628739:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1787579428.628855:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+20:10566:x1874412591703936:12345-192.168.206.53@tcp:58:lfs.0 Request processed in 640us (2220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579428.628864:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 128 00000100:00100000:2.0:1787579428.655621:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579428.655674:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591704320 00000100:00100000:0.0:1787579428.655685:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591704320 00000100:00100000:0.0:1787579428.655738:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 129 00000100:00100000:0.0:1787579428.655748:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+20:10569:x1874412591704320:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1787579428.655770:0:9530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579428.655790:0:9530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b761a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d0de expref: -99 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.655849:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7621 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.655863:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7621 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.655873:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7621 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.655887:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7628 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.655894:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7628 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.655911:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7628 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.656210:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b762f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.656245:0:9530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b753a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d09f expref: 21 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.656253:0:9530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b762f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.656296:0:9530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b753a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d09f expref: 21 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.656310:0:9530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b753a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d09f expref: 21 pid: 9532 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579428.656337:0:9530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1abd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9530:1874412616877184:192.168.206.53@tcp:104: 00000100:00100000:0.0:1787579428.656411:0:9530:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cec1bcb600 going to sleep for 11 seconds 00000100:00100000:0.0:1787579428.658979:0:9530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1abd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9530:1874412616877184:192.168.206.53@tcp:104: 00010000:00010000:0.0:1787579428.659003:0:9530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b762f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579428.659911:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579428.660005:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591704576 00000100:00100000:0.0:1787579428.660013:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591704576 00000100:00100000:1.0:1787579428.660196:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 33 00000100:00100000:1.0:1787579428.660208:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+22:5601:x1874412591704576:12345-192.168.206.53@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787579428.660626:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+23:5601:x1874412591704576:12345-192.168.206.53@tcp:35:ldlm_bl.0 Request processed in 419us (728us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1787579428.660633:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 33 00000100:00100000:1.0:1787579428.664659:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579428.664832:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591704704 00000100:00100000:2.0:1787579428.664841:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591704704 00010000:00010000:2.0:1787579428.664878:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b753a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d09f expref: 23 pid: 9532 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579428.664987:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 60 00000100:00100000:2.0:1787579428.664997:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf2f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+23:2359:x1874412591704704:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787579428.665011:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579428.665019:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b753a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d09f expref: 23 pid: 9532 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.665032:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b753a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d09f expref: 23 pid: 9532 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.665065:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152ec00/0xb72beeaffa1b753a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d09f expref: 23 pid: 9532 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.665081:0:8477:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:2.0:1787579428.665086:0:8477:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b762f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.665095:0:8477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b762f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.665102:0:8477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b762f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579428.665133:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579428.665188:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf2f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+22:2359:x1874412591704704:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 192us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579428.665195:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 60 00010000:00010000:0.0:1787579428.665393:0:9530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b762f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.665402:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b762f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579428.665440:0:9530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787579428.665444:0:9530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787579428.665468:0:9530:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b762f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.665481:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b762f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.665491:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7621 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.665497:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7621 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.665504:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7621 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.665510:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579428.665514:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7621 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.665521:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7621 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.665531:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:0.0:1787579428.665534:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579428.665538:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7621 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.665543:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7621 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.665555:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7628 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.665562:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7628 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.665574:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7628 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.665578:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9400 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579428.665581:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7628 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.665588:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7628 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.665595:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0ce82cbbe00) 00010000:00010000:0.0:1787579428.665598:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579428.665601:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7628 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.665613:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7628 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.665647:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b761a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0de expref: 22 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.665661:0:9530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b762f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0de expref: 21 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579428.665674:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:0.0:1787579428.665676:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787579428.665679:0:9530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c8400, rc 0) 00000100:00100000:0.0:1787579428.665714:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+21:10569:x1874412591704320:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 9968us (10100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579428.665729:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 129 00000040:00080000:3.0:1787579429.261957:0:12133:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787579429.261967:0:12133:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787579429.262014:0:12133:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787579429.262020:0:12133:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787579429.283548:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787579429.664268:0:11712:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787579429.664278:0:11712:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787579429.664315:0:11712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787579429.664321:0:11712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787579429.664437:0:11712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb3f1a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11712:1874412616877312:192.168.206.53@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787579429.664698:0:11712:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce87c05540 going to sleep for 11 seconds 00000100:00100000:3.0:1787579429.673340:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579429.673456:0:11712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb3f1a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11712:1874412616877312:192.168.206.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787579429.673638:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591704832 00000100:00100000:0.0:1787579429.673645:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591704832 00000100:00100000:0.0:1787579429.673721:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 130 00000100:00100000:0.0:1787579429.673731:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+21:10581:x1874412591704832:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787579429.673761:0:5866:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787579429.673857:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+21:10581:x1874412591704832:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 Request processed in 126us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579429.673865:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 130 00000100:00080000:2.0:1787579429.673953:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579429.678103:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579429.678200:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591705088 00000100:00100000:2.0:1787579429.678210:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591705088 00000100:00100000:2.0:1787579429.678264:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 131 00000100:00100000:2.0:1787579429.678273:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+21:10581:x1874412591705088:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787579429.678291:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579429.678309:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b7636 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d0e5 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579429.678418:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b763d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579429.678433:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b763d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579429.678443:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b763d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579429.678453:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787579429.678568:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b7636 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0e5 expref: 24 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579429.678585:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b763d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0e5 expref: 23 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579429.678593:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:2.0:1787579429.678596:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787579429.678600:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319600, rc 0) 00000100:00100000:2.0:1787579429.678658:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+23:10581:x1874412591705088:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 386us (564us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1787579429.678665:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 131 00000100:00100000:3.0:1787579429.684871:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579429.685057:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591705344 00000100:00100000:0.0:1787579429.685066:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591705344 00000100:00100000:0.0:1787579429.685132:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 132 00000100:00100000:0.0:1787579429.685143:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+23:10581:x1874412591705344:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787579429.685214:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b764b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579429.685229:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b764b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579429.685239:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b764b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579429.685429:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b764b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579429.685437:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b764b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579429.685453:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b764b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579429.685458:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579429.685462:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b764b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579429.685469:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b764b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579429.685480:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:0.0:1787579429.685483:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787579429.685487:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b764b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579429.685493:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b764b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579429.685633:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+24:10581:x1874412591705344:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 491us (772us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1787579429.685641:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 132 00000040:00080000:3.0:1787579429.686473:0:11712:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787579429.686478:0:11712:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787579429.687016:0:11712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787579429.687024:0:11712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787579429.688474:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579429.688567:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591705600 00000100:00100000:0.0:1787579429.688577:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591705600 00000100:00100000:0.0:1787579429.688619:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 34 00000100:00100000:0.0:1787579429.688628:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+24:10581:x1874412591705600:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787579429.689060:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+25:10581:x1874412591705600:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 Request processed in 431us (590us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1787579429.689069:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 34 00000100:00100000:1.0:1787579429.689736:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579429.689990:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591705728 00000100:00100000:0.0:1787579429.689997:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591705728 00000100:00100000:0.0:1787579429.690090:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:0.0:1787579429.690098:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce831d5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+25:2360:x1874412591705728:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579429.690122:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579429.690145:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b763d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0e5 expref: 25 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579429.690162:0:5851:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:0.0:1787579429.690167:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579429.690207:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce831d5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+24:2360:x1874412591705728:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 109us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579429.690213:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 8 00010000:00010000:0.0:1787579430.304073:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579430.578739:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579430.578768:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579430.578801:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579430.578821:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579430.578841:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579430.578875:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591706368 00000100:00100000:1.0:1787579430.578884:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591706368 00000100:00100000:1.0:1787579430.578963:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591705984 00000100:00100000:1.0:1787579430.578966:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591705984 00000100:00100000:1.0:1787579430.578988:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 127 00000100:00100000:1.0:1787579430.578997:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf2f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2359:x1874412591706368:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579430.579072:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf2f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2359:x1874412591706368:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 75us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579430.579080:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 127 00000100:00100000:1.0:1787579430.579096:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 128 00000100:00100000:1.0:1787579430.579103:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf2f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+24:2359:x1874412591705984:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579430.579132:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf2f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+24:2359:x1874412591705984:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 29us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579430.579139:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 128 00000100:00100000:0.0:1787579430.579180:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591705856 00000100:00100000:0.0:1787579430.579186:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591705856 00000100:00100000:0.0:1787579430.579224:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 285 00000100:00100000:0.0:1787579430.579232:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+13:2359:x1874412591705856:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579430.579275:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+13:2359:x1874412591705856:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 44us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579430.579279:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591706112 00000100:00100000:0.0:1787579430.579284:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 285 00000100:00100000:1.0:1787579430.579286:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591706112 00000100:00100000:1.0:1787579430.579327:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591706240 00000100:00100000:1.0:1787579430.579330:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591706240 00000100:00100000:0.0:1787579430.579333:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 55 00000100:00100000:0.0:1787579430.579343:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf2f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+7:2359:x1874412591706112:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579430.579359:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 56 00000100:00100000:1.0:1787579430.579368:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf2f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+6:2359:x1874412591706240:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579430.579375:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf2f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+7:2359:x1874412591706112:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 32us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579430.579382:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 55 00000100:00100000:1.0:1787579430.579403:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf2f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+6:2359:x1874412591706240:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 35us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579430.579411:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 56 00000100:00080000:2.0:1787579430.579473:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787579430.579478:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787579430.579480:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787579430.881087:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787579430.881161:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787579430.881180:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616877568:0@lo:400:kworker.0 00000100:00100000:2.0:1787579430.881204:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616877440:0@lo:400:kworker.0 00000100:00100000:0.0:1787579430.881333:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616877824:0@lo:400:kworker.0 00000100:00100000:3.0:1787579430.881377:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616877696:0@lo:400:kworker.0 00000100:00100000:1.0:1787579430.886367:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579430.886462:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba812d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616877952:0@lo:400:kworker.0 00000100:00100000:3.0:1787579430.886463:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579430.886500:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb3f1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616878208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787579430.886507:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579430.886532:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579430.886536:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787579430.886543:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce87ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1874412616878080:0@lo:400:kworker.0 00000100:00100000:1.0:1787579430.886565:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579430.886583:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616877568 00000100:00100000:1.0:1787579430.886587:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616877696 00000100:00100000:2.0:1787579430.886590:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616877568 00000100:00100000:1.0:1787579430.886590:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616877696 00000100:00100000:1.0:1787579430.886634:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616878080 00000100:00100000:0.0:1787579430.886635:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579430.886637:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616878080 00000100:00100000:1.0:1787579430.886687:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787579430.886695:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616877696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579430.886706:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616877952 00000100:00100000:0.0:1787579430.886709:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616877952 00000100:00100000:0.0:1787579430.886732:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616877824 00000100:00100000:0.0:1787579430.886735:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616877824 00000100:00100000:1.0:1787579430.886740:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616877696:12345-0@lo:400:kworker.0 Request processed in 46us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579430.886753:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787579430.886759:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf2f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3319:x1874412616877952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579430.886790:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf2f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3319:x1874412616877952:12345-0@lo:400:kworker.0 Request processed in 31us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579430.886796:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787579430.886810:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787579430.886816:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3322:x1874412616877824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579430.886824:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579430.886859:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787579430.886864:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787579430.886870:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616877568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579430.886877:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787579430.886882:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf2f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874412616878080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579430.886950:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3322:x1874412616877824:12345-0@lo:400:kworker.0 Request processed in 111us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579430.886956:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787579430.886990:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba812d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616877952:0@lo:400:kworker.0 00000100:00100000:0.0:1787579430.887113:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616877824:0@lo:400:kworker.0 00000100:00100000:3.0:1787579430.887180:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616877696:0@lo:400:kworker.0 00000100:00100000:2.0:1787579430.887299:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616877568:12345-0@lo:400:kworker.0 Request processed in 432us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579430.887305:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787579430.887392:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf2f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874412616878080:12345-0@lo:400:kworker.0 Request processed in 509us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579430.887399:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787579430.887434:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616877440 00000100:00100000:2.0:1787579430.887439:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616877440 00000100:00100000:2.0:1787579430.887549:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787579430.887556:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3320:x1874412616877440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579430.887585:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3320:x1874412616877440:12345-0@lo:400:kworker.0 Request processed in 31us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579430.887589:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:2.0:1787579430.887607:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787579430.887611:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787579430.887613:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787579430.887626:0:7952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616878208 00000100:00100000:2.0:1787579430.887629:0:7952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616878208 00000100:00100000:2.0:1787579430.887644:0:7952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787579430.887648:0:7952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1874412616878208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787579430.887668:0:7952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579430.887692:0:7952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1874412616878208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579430.887695:0:7952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787579430.887717:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb3f1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616878208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787579430.887736:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3320:1874412616877440:0@lo:400:kworker.0 00000100:00100000:0.0:1787579430.887786:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616877568:0@lo:400:kworker.0 00000100:00100000:0.0:1787579430.887796:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce87ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1874412616878080:0@lo:400:kworker.0 00000040:00080000:2.0:1787579431.008806:0:12184:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787579431.008816:0:12184:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787579431.008985:0:12184:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787579431.008992:0:12184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787579431.163049:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579431.163252:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591706624 00000100:00100000:0.0:1787579431.163261:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591706624 00000100:00100000:0.0:1787579431.163336:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 133 00000100:00100000:0.0:1787579431.163356:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf2f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+24:10601:x1874412591706624:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1787579431.163376:0:9530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579431.163406:0:9530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8600/0xb72beeaffa1b7652 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d0ec expref: -99 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579431.163501:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b7659 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579431.163514:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b7659 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579431.163528:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b7659 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579431.163538:0:9530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787579431.163656:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8600/0xb72beeaffa1b7652 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0ec expref: 27 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579431.163676:0:9530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b7659 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0ec expref: 26 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579431.163685:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:0.0:1787579431.163688:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787579431.163691:0:9530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c8000, rc 0) 00000100:00100000:0.0:1787579431.163758:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf2f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+26:10601:x1874412591706624:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 412us (717us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1787579431.163765:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 133 00000100:00080000:2.0:1787579431.163967:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579431.169207:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579431.172370:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591706752 00000100:00100000:2.0:1787579431.172386:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591706752 00000100:00100000:2.0:1787579431.172459:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 134 00000100:00100000:2.0:1787579431.172470:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf2f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+26:10601:x1874412591706752:12345-192.168.206.53@tcp:54:lfs.0 00010000:00010000:2.0:1787579431.172547:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7667 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579431.172563:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7667 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579431.172574:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7667 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579431.172599:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7667 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579431.172606:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7667 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579431.172613:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7667 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579431.172618:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba319400 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579431.172623:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7667 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579431.172649:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7667 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579431.172661:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:2.0:1787579431.172664:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787579431.172669:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7667 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579431.172675:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7667 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579431.172757:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf2f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+26:10601:x1874412591706752:12345-192.168.206.53@tcp:54:lfs.0 Request processed in 288us (3568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579431.172765:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 134 00010000:00010000:3.0:1787579431.328134:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579431.343332:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579431.343520:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591706880 00000100:00100000:0.0:1787579431.343529:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591706880 00000100:00100000:0.0:1787579431.343581:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 48 00000100:00100000:0.0:1787579431.343591:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+6:2359:x1874412591706880:12345-192.168.206.53@tcp:101:cat.0 00010000:00010000:0.0:1787579431.343628:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579431.343645:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082c9f210/0xb72beeaffa1b766e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d0f3 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787579431.343680:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8c4c23, atime: 0x6a8c4c22, ctime: 0x6a8c4c23, blocks: 0xb 00010000:00010000:0.0:1787579431.343698:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=367s v=(0 0) 00010000:00010000:0.0:1787579431.343703:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787579431.343712:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082c9f210/0xb72beeaffa1b766e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0f3 expref: 7 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579431.343730:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000082c9f210/0xb72beeaffa1b766e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0f3 expref: 7 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579431.343744:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c8600, rc 0) 00000100:00100000:0.0:1787579431.343801:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+7:2359:x1874412591706880:12345-192.168.206.53@tcp:101:cat.0 Request processed in 212us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579431.343808:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 48 00000100:00100000:1.0:1787579431.352976:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579431.353090:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591707008 00000100:00100000:2.0:1787579431.353105:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591707008 00002000:00100000:2.0:1787579431.353149:0:6716:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffffa0cebf2f2a00 x1874412591707008/t0(0) o3->963d8c17-1326-491b-be60-9002b9296555@192.168.206.53@tcp:672/0 lens 488/0 e 0 to 0 dl 1787579442 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787579431.353161:0:6716:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0cebf2f2a00 with x1874412591707008 ext(0->4095) 00002000:00010000:2.0:1787579431.353167:0:6716:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0cebf2f2a00 00000100:00100000:2.0:1787579431.353202:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 4 00000100:00100000:2.0:1787579431.353588:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf2f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:963d8c17-1326-491b-be60-9002b9296555+7:2361:x1874412591707008:12345-192.168.206.53@tcp:3:cat.0 00000100:00100000:2.0:1787579431.354015:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf2f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:963d8c17-1326-491b-be60-9002b9296555+7:2361:x1874412591707008:12345-192.168.206.53@tcp:3:cat.0 Request processed in 803us (1047us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787579431.354023:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 4 00002000:00100000:2.0:1787579431.354031:0:6716:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffffa0cebf2f2a00 x1874412591707008/t0(0) o3->963d8c17-1326-491b-be60-9002b9296555@192.168.206.53@tcp:672/0 lens 488/4536 e 0 to 0 dl 1787579442 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787579431.354052:0:6716:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0cebf2f2a00 with x1874412591707008 ext(0->4095) 00002000:00010000:2.0:1787579431.354056:0:6716:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0cebf2f2a00 00000100:00100000:1.0:1787579431.392893:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787579431.392958:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616878336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787579431.393030:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579431.393152:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616878336 00000100:00100000:2.0:1787579431.393160:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616878336 00000100:00100000:2.0:1787579431.393221:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787579431.393231:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf2f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1874412616878336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787579431.393264:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579431.393361:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf2f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1874412616878336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579431.393368:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787579431.393802:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616878336:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787579432.353108:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787579432.478655:0:6735:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1787579432.478679:0:6735:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:3.0:1787579433.376137:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787579434.069648:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1787579434.069663:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:1.0:1787579434.115280:0:5888:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1787579434.115308:0:5888:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1787579434.115337:0:5888:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0ceba43dc00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1787579434.115342:0:5888:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0cebf802600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0ceba43d9c0 00000020:00080000:1.0:1787579434.115346:0:5888:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0cebf802000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0ce987aac00 00000020:00080000:2.0:1787579434.115616:0:5899:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1787579434.115812:0:5899:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1787579434.408364:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579435.425153:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579435.702581:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579435.702625:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579435.702649:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579435.702668:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579435.702687:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579435.702709:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591707392 00000100:00100000:1.0:1787579435.702715:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591707136 00000100:00100000:2.0:1787579435.702717:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591707392 00000100:00100000:1.0:1787579435.702722:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591707136 00000100:00100000:2.0:1787579435.702773:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591707520 00000100:00100000:1.0:1787579435.702778:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 287 00000100:00100000:2.0:1787579435.702779:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591707520 00000100:00100000:2.0:1787579435.702801:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 59 00000100:00100000:1.0:1787579435.702806:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+13:2362:x1874412591707136:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1787579435.702815:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+5:2362:x1874412591707392:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579435.702888:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+13:2362:x1874412591707136:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 83us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579435.702897:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 287 00000100:00100000:1.0:1787579435.702948:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 60 00000100:00100000:1.0:1787579435.702956:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+6:2362:x1874412591707520:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1787579435.706745:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591707648 00000100:00100000:3.0:1787579435.706761:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591707648 00000100:00100000:3.0:1787579435.707207:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591707264 00000100:00100000:3.0:1787579435.707212:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591707264 00000100:00100000:2.0:1787579435.707290:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+5:2362:x1874412591707392:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 4473us (4659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579435.707306:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 59 00000100:00080000:2.0:1787579435.707334:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787579435.707339:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787579435.707341:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787579435.710236:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+6:2362:x1874412591707520:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 7272us (7538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579435.710249:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 60 00000100:00100000:3.0:1787579435.713083:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 132 00000100:00100000:3.0:1787579435.713103:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2362:x1874412591707648:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1787579435.713174:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2362:x1874412591707648:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 80us (10524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579435.713182:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 132 00000100:00100000:3.0:1787579435.713200:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 133 00000100:00100000:3.0:1787579435.713207:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+13:2362:x1874412591707264:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1787579435.713230:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+13:2362:x1874412591707264:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 24us (10561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579435.713237:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 133 00000100:00100000:2.0:1787579436.006231:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787579436.006252:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba82e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616878464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787579436.006319:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579436.006375:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616878464 00000100:00100000:2.0:1787579436.006382:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616878464 00000100:00100000:2.0:1787579436.006428:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787579436.006435:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616878464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787579436.006466:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579436.006506:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616878464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579436.006513:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1787579436.006533:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787579436.006556:0:3320:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1787579436.006561:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0cec1abce00, transno 4294967311 00000004:00080000:2.0:1787579436.006571:0:3320:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:2.0:1787579436.006596:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba82e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616878464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787579436.015729:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616878976:0@lo:400:kworker.0 00000100:00100000:3.0:1787579436.015817:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579436.015871:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787579436.015877:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce87ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616878592:0@lo:400:kworker.0 00000100:00100000:3.0:1787579436.015907:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579436.015946:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1874412616879104:0@lo:400:kworker.0 00000100:00100000:3.0:1787579436.015972:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579436.016010:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616878976 00000100:00100000:3.0:1787579436.016017:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616878976 00000100:00100000:3.0:1787579436.016067:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787579436.016076:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616878976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579436.016122:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616878976:12345-0@lo:400:kworker.0 Request processed in 47us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579436.016129:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787579436.016147:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616878592 00000100:00100000:3.0:1787579436.016150:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616878592 00000100:00100000:3.0:1787579436.016170:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787579436.016176:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3319:x1874412616878592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579436.016203:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3319:x1874412616878592:12345-0@lo:400:kworker.0 Request processed in 27us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579436.016209:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787579436.016233:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616879104 00000100:00100000:3.0:1787579436.016236:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616879104 00000100:00100000:3.0:1787579436.016257:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787579436.016263:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874412616879104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579436.016285:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874412616879104:12345-0@lo:400:kworker.0 Request processed in 23us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579436.016290:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:3.0:1787579436.016302:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787579436.016305:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787579436.016325:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce87ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616878592:0@lo:400:kworker.0 00000100:00100000:3.0:1787579436.016336:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1874412616879104:0@lo:400:kworker.0 00000100:00100000:3.0:1787579436.016343:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1787579436.016348:0:3319:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1787579436.016372:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0cebf2f0a80, transno 4294967304 00000100:00100000:3.0:1787579436.016382:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616878976:0@lo:400:kworker.0 00000100:00100000:0.0:1787579436.017101:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616878720:0@lo:400:kworker.0 00000100:00100000:0.0:1787579436.017143:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579436.017169:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787579436.017177:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616878848:0@lo:400:kworker.0 00000100:00100000:0.0:1787579436.017199:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579436.017227:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616878720 00000100:00100000:0.0:1787579436.017231:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616878720 00000100:00100000:0.0:1787579436.017258:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616878848 00000100:00100000:0.0:1787579436.017268:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616878848 00000100:00100000:0.0:1787579436.017293:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787579436.017300:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616878720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579436.017339:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616878720:12345-0@lo:400:kworker.0 Request processed in 39us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579436.017347:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787579436.017361:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787579436.017367:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616878848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579436.017391:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616878848:12345-0@lo:400:kworker.0 Request processed in 25us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579436.017396:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787579436.017423:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616878848:0@lo:400:kworker.0 00000100:00100000:0.0:1787579436.017431:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616878720:0@lo:400:kworker.0 00000100:00080000:3.0:1787579436.017722:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787579436.448392:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579436.514897:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebf2f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616879232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787579436.514990:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579436.515303:0:7952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616879232 00000100:00100000:3.0:1787579436.515310:0:7952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616879232 00000100:00100000:3.0:1787579436.515457:0:7952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787579436.515477:0:7952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616879232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787579436.515511:0:7952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787579436.515562:0:7952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616879232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579436.515568:0:7952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787579436.515638:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebf2f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616879232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787579436.528361:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579436.528455:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591707776 00000100:00100000:0.0:1787579436.528474:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591707776 00000100:00100000:0.0:1787579436.528536:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 135 00000100:00100000:0.0:1787579436.528546:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+13:10246:x1874412591707776:12345-192.168.206.53@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787579436.528643:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+13:10246:x1874412591707776:12345-192.168.206.53@tcp:60:lhsmtool_posix.0 Request processed in 98us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579436.528650:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 135 00000100:00100000:1.0:1787579436.530520:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579436.530663:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591708032 00000100:00100000:0.0:1787579436.530692:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591708032 00000100:00100000:0.0:1787579436.530738:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 35 00000100:00100000:0.0:1787579436.530747:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+13:10246:x1874412591708032:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787579436.531310:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+14:10246:x1874412591708032:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 Request processed in 562us (795us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1787579436.531319:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 35 00000100:00100000:1.0:1787579436.899601:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579436.899734:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591708160 00000100:00100000:3.0:1787579436.899747:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591708160 00000100:00100000:3.0:1787579436.899820:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 136 00000100:00100000:3.0:1787579436.899832:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf2f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:11054:x1874412591708160:12345-192.168.206.53@tcp:101:lsof.0 00010000:00010000:3.0:1787579436.899867:0:9530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579436.899897:0:9530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7675 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d0fa expref: -99 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579436.900242:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8aa00/0xb72beeaffa1b767c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579436.900259:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8aa00/0xb72beeaffa1b767c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579436.900274:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8aa00/0xb72beeaffa1b767c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579436.900669:0:9530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787579436.900682:0:9530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787579436.900788:0:9530:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8aa00/0xb72beeaffa1b767c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579436.900824:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7675 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0fa expref: 7 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579436.900844:0:9530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8aa00/0xb72beeaffa1b767c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0fa expref: 6 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579436.900866:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0cea147d400) 00010000:00010000:3.0:1787579436.900870:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787579436.901491:0:9530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce90a8aa00, rc 0) 00000100:00100000:3.0:1787579436.901584:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf2f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10f8d08d-5315-46af-9d52-63a85ea5c0aa+6:11054:x1874412591708160:12345-192.168.206.53@tcp:101:lsof.0 Request processed in 1752us (1994us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579436.901594:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 136 00010000:00010000:3.0:1787579437.472155:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787579437.856177:0:11712:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787579437.856187:0:11712:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787579437.856465:0:11712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1787579437.856476:0:11712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787579438.496269:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787579439.151513:0:5888:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1787579439.151535:0:5888:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1787579439.151602:0:5899:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1787579439.151612:0:5899:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1787579439.520214:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579440.544859:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579440.822165:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579440.822199:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579440.822221:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579440.822239:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579440.822258:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579440.822296:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591708544 00000100:00100000:1.0:1787579440.822303:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591708544 00000100:00100000:1.0:1787579440.822345:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591708672 00000100:00100000:1.0:1787579440.822347:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591708672 00000100:00100000:1.0:1787579440.822370:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 62 00000100:00100000:1.0:1787579440.822379:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf2f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+5:2359:x1874412591708544:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579440.822444:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf2f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+5:2359:x1874412591708544:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 66us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579440.822452:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 62 00000100:00100000:1.0:1787579440.822469:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 63 00000100:00100000:1.0:1787579440.822475:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+6:2359:x1874412591708672:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579440.822499:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+6:2359:x1874412591708672:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 25us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579440.822506:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 63 00000100:00100000:1.0:1787579440.822523:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591708800 00000100:00100000:1.0:1787579440.822526:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591708800 00000100:00100000:1.0:1787579440.822550:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591708416 00000100:00100000:1.0:1787579440.822553:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591708416 00000100:00100000:1.0:1787579440.822575:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 137 00000100:00100000:1.0:1787579440.822583:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf2f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10f8d08d-5315-46af-9d52-63a85ea5c0aa+6:2359:x1874412591708800:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579440.822625:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf2f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10f8d08d-5315-46af-9d52-63a85ea5c0aa+6:2359:x1874412591708800:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 42us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579440.822631:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 137 00000100:00100000:1.0:1787579440.822646:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 138 00000100:00100000:1.0:1787579440.822653:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+13:2359:x1874412591708416:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579440.822682:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+13:2359:x1874412591708416:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 29us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579440.822695:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 138 00000100:00100000:3.0:1787579440.828323:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591708288 00000100:00100000:3.0:1787579440.828336:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591708288 00000100:00100000:3.0:1787579440.828445:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 289 00000100:00100000:3.0:1787579440.828502:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+13:2359:x1874412591708288:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1787579440.828589:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+13:2359:x1874412591708288:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 134us (6430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579440.828607:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 289 00000100:00080000:3.0:1787579440.828651:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787579440.828657:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787579440.828660:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1787579440.877328:0:12388:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 09:50:38 (1787579438) 00000100:00100000:3.0:1787579441.120115:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba82e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616879360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787579441.120183:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579441.120298:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616879360 00000100:00100000:2.0:1787579441.120306:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616879360 00000100:00100000:2.0:1787579441.120366:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787579441.120376:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3f19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616879360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787579441.120408:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579441.120452:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3f19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616879360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579441.120458:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1787579441.120521:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787579441.120557:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba82e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616879360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787579441.124053:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616879872:0@lo:400:kworker.0 00000100:00100000:3.0:1787579441.124115:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579441.124150:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787579441.124156:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce87ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3322:1874412616879744:0@lo:400:kworker.0 00000100:00100000:3.0:1787579441.124180:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579441.124211:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616879744 00000100:00100000:3.0:1787579441.124217:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616879744 00000100:00100000:3.0:1787579441.124274:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787579441.124283:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1874412616879744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579441.124329:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1874412616879744:12345-0@lo:400:kworker.0 Request processed in 47us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579441.124335:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:3.0:1787579441.124355:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787579441.124380:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce87ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3322:1874412616879744:0@lo:400:kworker.0 00000100:00100000:1.0:1787579441.124459:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb3f1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616879488:0@lo:400:kworker.0 00000100:00100000:1.0:1787579441.124494:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579441.124527:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4694a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1874412616880000:0@lo:400:kworker.0 00000100:00100000:1.0:1787579441.124550:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579441.124569:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787579441.124574:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb3f1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616879616:0@lo:400:kworker.0 00000100:00100000:1.0:1787579441.124595:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579441.124635:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616879872 00000100:00100000:1.0:1787579441.124639:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616879872 00000100:00100000:1.0:1787579441.124670:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787579441.124676:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4697100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616879872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579441.124710:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4697100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616879872:12345-0@lo:400:kworker.0 Request processed in 34us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579441.124717:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787579441.124733:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616880000 00000100:00100000:1.0:1787579441.124736:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616880000 00000100:00100000:1.0:1787579441.124756:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616879616 00000100:00100000:1.0:1787579441.124759:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616879616 00000100:00100000:1.0:1787579441.124786:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787579441.124792:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce830ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874412616880000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579441.124825:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce830ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874412616880000:12345-0@lo:400:kworker.0 Request processed in 33us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579441.124843:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787579441.124855:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787579441.124861:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616879616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579441.124901:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616879616:12345-0@lo:400:kworker.0 Request processed in 41us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579441.124908:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:1.0:1787579441.124952:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787579441.124956:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787579441.124974:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb3f1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616879616:0@lo:400:kworker.0 00000100:00100000:1.0:1787579441.124984:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4694a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1874412616880000:0@lo:400:kworker.0 00000100:00100000:1.0:1787579441.125009:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616879872:0@lo:400:kworker.0 00000100:00100000:3.0:1787579441.125184:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616879488 00000100:00100000:3.0:1787579441.125188:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616879488 00000100:00100000:3.0:1787579441.125222:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1787579441.125229:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3319:x1874412616879488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579441.125273:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3319:x1874412616879488:12345-0@lo:400:kworker.0 Request processed in 44us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579441.125280:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787579441.126744:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb3f1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616879488:0@lo:400:kworker.0 00010000:00010000:3.0:1787579441.568388:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579441.633059:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787579441.633081:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce89239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616880128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787579441.633150:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579441.633339:0:7952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616880128 00000100:00100000:0.0:1787579441.633347:0:7952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616880128 00000100:00100000:0.0:1787579441.633400:0:7952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787579441.633410:0:7952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4696d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616880128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787579441.633444:0:7952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579441.633493:0:7952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4696d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616880128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579441.633500:0:7952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787579441.633584:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce89239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616880128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787579442.242389:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579442.242489:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591709056 00000100:00100000:2.0:1787579442.242499:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591709056 00000100:00100000:2.0:1787579442.242581:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 137 00000100:00100000:2.0:1787579442.242593:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+13:11320:x1874412591709056:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787579442.242620:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579442.242638:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7683 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d101 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579442.242701:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b768a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579442.242719:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b768a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579442.242731:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b768a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579442.242781:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7691 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579442.242789:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7691 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579442.242809:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7691 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579442.243459:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7698 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579442.243469:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7698 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579442.243477:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7698 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579442.243486:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787579442.244506:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b768a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579442.244519:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b768a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579442.244526:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b768a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579442.244532:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba319000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579442.244537:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b768a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579442.244545:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b768a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579442.244558:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0ce86456d00) 00010000:00010000:2.0:1787579442.244562:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00080000:1.0:1787579442.246426:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787579442.247381:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b768a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579442.247394:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b768a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579442.247415:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7691 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579442.247423:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7691 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579442.247429:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7691 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579442.247435:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579442.247439:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7691 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579442.247446:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7691 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579442.247460:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffffa0cea147db00) 00010000:00010000:2.0:1787579442.247463:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579442.247467:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7691 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579442.247472:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b7691 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579442.248760:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7683 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d101 expref: 16 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579442.248793:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7698 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d101 expref: 15 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579442.248801:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0ce84d55300) 00010000:00010000:2.0:1787579442.248803:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579442.248806:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba318a00, rc 0) 00000100:00100000:2.0:1787579442.248887:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+15:11320:x1874412591709056:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 6296us (6507us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1787579442.248895:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 137 00000100:00100000:2.0:1787579442.254199:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579442.254274:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591709184 00000100:00100000:3.0:1787579442.254283:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591709184 00000100:00100000:3.0:1787579442.254346:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00100000:3.0:1787579442.254356:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+15:2361:x1874412591709184:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787579442.254371:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579442.254405:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7698 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d101 expref: 15 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579442.254424:0:8477:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0ce84d55300) 00010000:00010000:3.0:1787579442.254429:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579442.254484:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+14:2361:x1874412591709184:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 130us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579442.254492:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00100000:1.0:1787579442.258676:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579442.266716:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591709312 00000100:00100000:0.0:1787579442.266732:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591709312 00000100:00100000:1.0:1787579442.266895:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 138 00000100:00100000:1.0:1787579442.266907:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+14:11320:x1874412591709312:12345-192.168.206.53@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787579442.267049:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+14:11320:x1874412591709312:12345-192.168.206.53@tcp:59:lhsmtool_posix.0 Request processed in 144us (8381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579442.267056:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 138 00010000:00010000:0.0:1787579442.596746:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787579442.977403:0:11712:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787579442.977412:0:11712:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787579442.978521:0:11712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1787579442.978530:0:11712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787579443.616384:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579444.224351:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579444.224823:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591709440 00000100:00100000:0.0:1787579444.224836:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591709440 00000100:00100000:0.0:1787579444.224897:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 139 00000100:00100000:0.0:1787579444.224907:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8923b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+14:11362:x1874412591709440:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1787579444.224958:0:9530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579444.224978:0:9530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b76a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d108 expref: -99 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.225039:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b76ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.225060:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b76ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.225074:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b76ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.225092:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b76b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.225100:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b76b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.225107:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b76b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787579444.225244:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787579444.228169:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b76ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.228186:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b76ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.228194:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b76ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.228199:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579444.228204:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b76ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.228212:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b76ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.228227:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0cea147d400) 00010000:00010000:0.0:1787579444.228236:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579444.228241:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b76ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.228247:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b76ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.228259:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b76b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.228265:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b76b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.228271:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b76b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.228277:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579444.228281:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b76b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.228286:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b76b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.228295:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffffa0ce82cbbe00) 00010000:00010000:0.0:1787579444.228298:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579444.228301:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b76b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.228306:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b76b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.228349:0:9530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b76a6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d108 expref: 15 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.228371:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0cea147d400) 00010000:00010000:0.0:1787579444.228374:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579444.228379:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b76a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d108 expref: 15 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.228389:0:9530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c8800, rc 0) 00000100:00100000:0.0:1787579444.228458:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8923b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+14:11362:x1874412591709440:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 3552us (4115us total) trans 0 rc 301/301 00000100:00100000:0.0:1787579444.228466:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 139 00000100:00100000:1.0:1787579444.239273:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579444.239337:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591709696 00000100:00100000:0.0:1787579444.239347:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591709696 00000100:00100000:0.0:1787579444.239397:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 140 00000100:00100000:0.0:1787579444.239409:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+14:11362:x1874412591709696:12345-192.168.206.53@tcp:36:lfs.0 00010000:00010000:0.0:1787579444.239459:0:5868:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579444.239485:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7024 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf41 expref: 14 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.239502:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0cea147d400) 00010000:00010000:0.0:1787579444.239508:0:5868:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787579444.239774:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b76bb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.239789:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8aa00/0xb72beeaffa1b767c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0fa expref: 5 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.239798:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b76bb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.239848:0:5868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8aa00/0xb72beeaffa1b767c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0fa expref: 5 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.239861:0:5868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8aa00/0xb72beeaffa1b767c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0fa expref: 5 pid: 9530 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579444.239876:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1abd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5868:1874412616880256:192.168.206.53@tcp:104: 00000100:00100000:0.0:1787579444.239991:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d11d900 going to sleep for 11 seconds 00000100:00100000:1.0:1787579444.242182:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579444.242260:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1abd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5868:1874412616880256:192.168.206.53@tcp:104: 00010000:00010000:3.0:1787579444.242284:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b76bb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579444.242357:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591709824 00000100:00100000:0.0:1787579444.242363:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591709824 00010000:00010000:0.0:1787579444.242410:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8aa00/0xb72beeaffa1b767c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0fa expref: 6 pid: 9530 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579444.242475:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 61 00000100:00100000:0.0:1787579444.242485:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89238e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10f8d08d-5315-46af-9d52-63a85ea5c0aa+6:2359:x1874412591709824:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579444.242498:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579444.242504:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8aa00/0xb72beeaffa1b767c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0fa expref: 6 pid: 9530 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.242515:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8aa00/0xb72beeaffa1b767c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0fa expref: 6 pid: 9530 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.242537:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8aa00/0xb72beeaffa1b767c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0fa expref: 6 pid: 9530 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.242552:0:5851:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0cea147d400) 00010000:00010000:0.0:1787579444.242563:0:5851:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b76bb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.242571:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b76bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.242578:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b76bb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.242611:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579444.242658:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89238e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2359:x1874412591709824:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 175us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579444.242666:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 61 00000100:00080000:1.0:1787579444.242708:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1787579444.244006:0:5888:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:0.0:1787579444.244475:0:5868:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b76bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.244485:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b76bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.244509:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b76c2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.244520:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b76c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.244530:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b76c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579444.248212:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787579444.248228:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b76bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.248238:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b76bb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.248254:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b76bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.248260:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9c00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579444.248265:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b76bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.248273:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b76bb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.248289:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0cea147d400) 00010000:00010000:0.0:1787579444.248293:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579444.248297:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b76bb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.248304:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b76bb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787579444.248322:0:5868:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008155db93 reply state 0000000022cbc979 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b76c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579444.248331:0:5868:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787579444.248414:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+14:11362:x1874412591709696:12345-192.168.206.53@tcp:36:lfs.0 Request processed in 9003us (9147us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1787579444.248422:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 140 00010000:00010000:1.0:1787579444.255764:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b76c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579444.255789:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b76c2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579444.255796:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b76c2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579444.255803:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579444.255808:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b76c2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579444.255828:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b76c2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579444.255845:0:3306:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffffa0ce82cbbe00) 00010000:00010000:1.0:1787579444.255849:0:3306:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579444.255854:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b76c2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579444.255859:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b76c2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579444.350808:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579444.350967:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591709952 00000100:00100000:0.0:1787579444.350976:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591709952 00000100:00100000:0.0:1787579444.351035:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 141 00000100:00100000:0.0:1787579444.351044:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+13:11370:x1874412591709952:12345-192.168.206.53@tcp:101:lctl.0 00010000:00010000:0.0:1787579444.351085:0:9532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579444.351117:0:9532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b76c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d10f expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.351188:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8c00/0xb72beeaffa1b76d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.351200:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8c00/0xb72beeaffa1b76d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.351211:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8c00/0xb72beeaffa1b76d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579444.351265:0:9532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787579444.351269:0:9532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787579444.351295:0:9532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8c00/0xb72beeaffa1b76d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.351317:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b76c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d10f expref: 15 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.351336:0:9532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8c00/0xb72beeaffa1b76d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d10f expref: 14 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.351344:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce82cbb500) 00010000:00010000:0.0:1787579444.351347:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787579444.351350:0:9532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c8c00, rc 0) 00000100:00100000:0.0:1787579444.351398:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+14:11370:x1874412591709952:12345-192.168.206.53@tcp:101:lctl.0 Request processed in 355us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579444.351405:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 141 00000100:00100000:1.0:1787579444.437700:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579444.437847:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591710080 00000100:00100000:2.0:1787579444.437858:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591710080 00000100:00100000:2.0:1787579444.437916:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 142 00000100:00100000:2.0:1787579444.437959:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+14:11376:x1874412591710080:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:2.0:1787579444.437979:0:9530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579444.437999:0:9530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b76d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d116 expref: -99 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.438055:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b76de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.438069:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b76de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.438095:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b76de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.438111:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b76e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.438118:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b76e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.438124:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b76e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.438230:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b76ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.438237:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b76ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.438244:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b76ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579444.438271:0:9530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787579444.438274:0:9530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787579444.438294:0:9530:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b76ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.438305:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b76de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.438311:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b76de lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.438325:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b76de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.438331:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba319600 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579444.438336:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b76de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.438343:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b76de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.438354:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce82cbb500) 00010000:00010000:2.0:1787579444.438357:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579444.438362:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b76de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.438367:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b76de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.438379:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b76e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.438386:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b76e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.438392:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b76e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.438396:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579444.438400:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b76e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.438414:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b76e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.438423:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffffa0cea147d100) 00010000:00010000:2.0:1787579444.438425:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579444.438428:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b76e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.438432:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b76e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.438460:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b76d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d116 expref: 16 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.438472:0:9530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b76ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d116 expref: 15 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.438479:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:2.0:1787579444.438481:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787579444.438483:0:9530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba318c00, rc 0) 00000100:00100000:2.0:1787579444.438697:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+15:11376:x1874412591710080:12345-192.168.206.53@tcp:101:bash.0 Request processed in 772us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579444.438705:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 142 00000100:00100000:1.0:1787579444.446024:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579444.446113:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591710336 00000100:00100000:0.0:1787579444.446123:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591710336 00000100:00100000:0.0:1787579444.446195:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 143 00000100:00100000:0.0:1787579444.446206:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+15:11376:x1874412591710336:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:0.0:1787579444.446225:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579444.446247:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b76f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d11d expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.446382:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b76fa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.446397:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b76fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.446408:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b76fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.446443:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7701 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.446450:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7701 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.446457:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7701 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787579444.447015:0:5868:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1787579444.447166:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b7708 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.447177:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b7708 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.447192:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b7708 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.447226:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b76fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.447233:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b76fa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.447239:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b76fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.447245:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9600 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579444.447249:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b76fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.447256:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b76fa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.447268:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:0.0:1787579444.447272:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579444.447276:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b76fa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.447281:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b76fa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787579444.447294:0:5868:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000acb6052c reply state 0000000000d3499f transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7701 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579444.447302:0:5868:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787579444.447339:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b76f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d11d expref: 18 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.447354:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b7708 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d11d expref: 17 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.447361:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb900) 00010000:00010000:0.0:1787579444.447364:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787579444.447366:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c9a00, rc 0) 00000100:00100000:0.0:1787579444.447444:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+18:11376:x1874412591710336:12345-192.168.206.53@tcp:101:bash.0 Request processed in 1239us (1428us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1787579444.447452:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 143 00010000:00010000:0.0:1787579444.451052:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7701 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.451067:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7701 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.451074:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7701 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.451080:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579444.451084:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7701 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.451090:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7701 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.451106:0:3305:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0ce82cbb100) 00010000:00010000:0.0:1787579444.451109:0:3305:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579444.451126:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7701 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.451132:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7701 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579444.457376:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579444.457576:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591710464 00000100:00100000:2.0:1787579444.457592:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591710464 00000100:00100000:2.0:1787579444.457656:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 49 00000100:00100000:2.0:1787579444.457667:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+5:2361:x1874412591710464:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:2.0:1787579444.457702:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579444.457725:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076945f3f/0xb72beeaffa1b7716 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d124 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787579444.457752:0:6712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787579444.457770:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=380s v=(0 0) 00010000:00010000:2.0:1787579444.457775:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579444.457784:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076945f3f/0xb72beeaffa1b7716 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d124 expref: 6 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.457801:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000076945f3f/0xb72beeaffa1b7716 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d124 expref: 6 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.457826:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba318000, rc 0) 00000100:00100000:2.0:1787579444.457881:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+6:2361:x1874412591710464:12345-192.168.206.53@tcp:101:bash.0 Request processed in 216us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579444.457889:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 49 00000100:00080000:1.0:1787579444.457964:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787579444.463323:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579444.464533:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591710592 00000100:00100000:1.0:1787579444.464544:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591710592 00000100:00100000:1.0:1787579444.464766:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 50 00000100:00100000:1.0:1787579444.464776:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4695180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+6:11376:x1874412591710592:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:1.0:1787579444.464807:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579444.464836:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f583c61/0xb72beeaffa1b771d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d12b expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579444.464866:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000076945f3f/0xb72beeaffa1b7716 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d124 expref: 7 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579444.464875:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579444.464888:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579444.464893:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f583c61/0xb72beeaffa1b771d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d12b expref: 7 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579444.465007:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000076945f3f/0xb72beeaffa1b7716 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d124 expref: 7 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579444.465021:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000076945f3f/0xb72beeaffa1b7716 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d124 expref: 7 pid: 6712 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579444.465042:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6711:1874412616880384:192.168.206.53@tcp:104: 00000100:00100000:1.0:1787579444.465159:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d375e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787579444.468258:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6711:1874412616880384:192.168.206.53@tcp:104: 00010000:00010000:1.0:1787579444.468291:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f583c61/0xb72beeaffa1b771d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d12b expref: 7 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579444.468311:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb47c9600, rc 0) 00000100:00100000:1.0:1787579444.468414:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4695180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+7:11376:x1874412591710592:12345-192.168.206.53@tcp:101:bash.0 Request processed in 3639us (5099us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579444.468422:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 50 00000100:00100000:3.0:1787579444.470351:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579444.471451:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591710720 00000100:00100000:2.0:1787579444.471463:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591710720 00010000:00010000:2.0:1787579444.471571:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000076945f3f/0xb72beeaffa1b7716 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d124 expref: 7 pid: 6712 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579444.471657:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 62 00000100:00100000:2.0:1787579444.471669:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4694e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+7:2360:x1874412591710720:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787579444.471686:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579444.471720:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000076945f3f/0xb72beeaffa1b7716 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d124 expref: 7 pid: 6712 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.471734:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000076945f3f/0xb72beeaffa1b7716 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d124 expref: 7 pid: 6712 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.471756:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076945f3f/0xb72beeaffa1b7716 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d124 expref: 7 pid: 6712 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.471772:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579444.471777:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579444.471785:0:8477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002f583c61/0xb72beeaffa1b771d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d12b expref: 6 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.471796:0:8477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f583c61/0xb72beeaffa1b771d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d12b expref: 6 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.471842:0:8477:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002f583c61/0xb72beeaffa1b771d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d12b expref: 6 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579444.471858:0:8477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba82df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8477:1874412616880512:192.168.206.53@tcp:105: 00000100:00100000:2.0:1787579444.471980:0:8477:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceba43d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787579444.474413:0:8477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba82df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8477:1874412616880512:192.168.206.53@tcp:105: 00010000:00010000:2.0:1787579444.474438:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579444.474496:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4694e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+6:2360:x1874412591710720:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 2829us (4151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579444.474521:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 62 00000100:00100000:1.0:1787579444.479223:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579444.479306:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591710976 00000100:00100000:0.0:1787579444.479315:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591710976 00000100:00100000:0.0:1787579444.479373:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 36 00000100:00100000:0.0:1787579444.479384:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+17:11376:x1874412591710976:12345-192.168.206.53@tcp:35:bash.0 00000100:00100000:0.0:1787579444.479697:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+18:11376:x1874412591710976:12345-192.168.206.53@tcp:35:bash.0 Request processed in 313us (481us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1787579444.479705:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 36 00000100:00100000:0.0:1787579444.613847:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579444.614095:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591711232 00000100:00100000:3.0:1787579444.614105:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591711232 00000100:00100000:3.0:1787579444.614161:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 144 00000100:00100000:3.0:1787579444.614171:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+18:11386:x1874412591711232:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1787579444.614195:0:5866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579444.614215:0:5866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7724 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d132 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579444.614317:0:5866:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787579444.614430:0:5866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7724 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d132 expref: 20 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579444.614446:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce82cbb500) 00010000:00010000:3.0:1787579444.614449:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787579444.614453:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7724 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d132 expref: 20 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579444.614467:0:5866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce90a8b000, rc 0) 00000100:00100000:3.0:1787579444.614591:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+19:11386:x1874412591711232:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 410us (741us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1787579444.614600:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 144 00000100:00100000:2.0:1787579444.624696:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579444.625195:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591711488 00000100:00100000:0.0:1787579444.625205:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591711488 00000100:00100000:0.0:1787579444.625260:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 37 00000100:00100000:0.0:1787579444.625271:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+19:11386:x1874412591711488:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:0.0:1787579444.625516:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+20:11386:x1874412591711488:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 246us (829us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1787579444.625524:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 37 00010000:00010000:1.0:1787579444.650000:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579444.749876:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579444.750103:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591711616 00000100:00100000:2.0:1787579444.750113:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591711616 00000100:00100000:2.0:1787579444.750172:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 145 00000100:00100000:2.0:1787579444.750183:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+20:11392:x1874412591711616:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1787579444.750205:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579444.750226:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7732 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d139 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.750289:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7739 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.750303:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7739 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.750313:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7739 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579444.750368:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787579444.750372:0:5867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787579444.750394:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7739 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.750420:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7732 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d139 expref: 22 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.750436:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7739 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d139 expref: 21 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.750462:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:2.0:1787579444.750465:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787579444.750468:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319400, rc 0) 00000100:00100000:2.0:1787579444.750527:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+21:11392:x1874412591711616:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 345us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579444.750534:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 145 00000100:00100000:1.0:1787579444.757001:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579444.757105:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591711872 00000100:00100000:0.0:1787579444.757115:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591711872 00000100:00100000:0.0:1787579444.757171:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 146 00000100:00100000:0.0:1787579444.757182:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec17c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+21:11392:x1874412591711872:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1787579444.757201:0:9532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579444.757222:0:9532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7740 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d140 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.757333:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7747 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.757347:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7747 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.757358:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7747 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579444.757369:0:9532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787579444.757485:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7740 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d140 expref: 24 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.757521:0:9532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7747 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d140 expref: 23 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.757529:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb900) 00010000:00010000:0.0:1787579444.757532:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787579444.757536:0:9532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c8200, rc 0) 00000100:00100000:0.0:1787579444.757600:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec17c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+23:11392:x1874412591711872:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 419us (607us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1787579444.757607:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 146 00000100:00100000:3.0:1787579444.762486:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579444.762663:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591712128 00000100:00100000:0.0:1787579444.762673:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591712128 00000100:00100000:0.0:1787579444.762729:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 147 00000100:00100000:0.0:1787579444.762738:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+23:11392:x1874412591712128:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1787579444.762772:0:5866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579444.762822:0:5866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7755 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d147 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.762943:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b775c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.762957:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b775c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.762967:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b775c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579444.762980:0:5866:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787579444.763103:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7755 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d147 expref: 26 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.763120:0:5866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b775c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d147 expref: 25 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.763129:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb900) 00010000:00010000:0.0:1787579444.763132:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787579444.763135:0:5866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c9c00, rc 0) 00000100:00100000:0.0:1787579444.763198:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+25:11392:x1874412591712128:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 461us (720us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1787579444.763206:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 147 00000100:00100000:1.0:1787579444.764897:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579444.765026:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591712256 00000100:00100000:3.0:1787579444.765034:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591712256 00000100:00100000:3.0:1787579444.765112:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:3.0:1787579444.765122:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec17c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:963d8c17-1326-491b-be60-9002b9296555+25:2359:x1874412591712256:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787579444.765136:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579444.765157:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7747 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d140 expref: 25 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579444.765175:0:5852:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb900) 00010000:00010000:3.0:1787579444.765179:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579444.765233:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec17c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:963d8c17-1326-491b-be60-9002b9296555+24:2359:x1874412591712256:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 112us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579444.765242:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:1.0:1787579444.772187:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579444.772270:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591712384 00000100:00100000:2.0:1787579444.772279:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591712384 00000100:00100000:2.0:1787579444.772332:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 51 00000100:00100000:2.0:1787579444.772342:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+6:2361:x1874412591712384:12345-192.168.206.53@tcp:1:lfs.0 00010000:00010000:2.0:1787579444.772382:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076945f3f/0xb72beeaffa1b776a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.772401:0:6712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002f583c61/0xb72beeaffa1b771d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d12b expref: 6 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.772410:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579444.772414:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787579444.772418:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076945f3f/0xb72beeaffa1b776a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.772452:0:6712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002f583c61/0xb72beeaffa1b771d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d12b expref: 6 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.772466:0:6712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002f583c61/0xb72beeaffa1b771d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d12b expref: 6 pid: 6711 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579444.772495:0:6712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba82e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6712:1874412616880640:192.168.206.53@tcp:104: 00000100:00100000:2.0:1787579444.772573:0:6712:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceba43d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787579444.776857:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579444.776959:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591712512 00000100:00100000:3.0:1787579444.776968:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591712512 00002000:00100000:3.0:1787579444.777012:0:6715:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffffa0ce812a9c00 x1874412591712512/t0(0) o4->963d8c17-1326-491b-be60-9002b9296555@192.168.206.53@tcp:685/0 lens 504/0 e 0 to 0 dl 1787579455 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787579444.777024:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0ce812a9c00 with x1874412591712512 ext(0->12) 00010000:00010000:3.0:1787579444.777033:0:6715:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002f583c61/0xb72beeaffa1b771d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d12b expref: 7 pid: 6711 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579444.777049:0:6715:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002f583c61/0xb72beeaffa1b771d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d12b expref: 7 pid: 6711 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787579444.777056:0:6715:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa0ce812a9c00 00000100:00100000:3.0:1787579444.777079:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 2 00000100:00100000:3.0:1787579444.777088:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:963d8c17-1326-491b-be60-9002b9296555+7:2360:x1874412591712512:12345-192.168.206.53@tcp:4:lfs.0 00000100:00100000:3.0:1787579444.777524:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:963d8c17-1326-491b-be60-9002b9296555+9:2360:x1874412591712512:12345-192.168.206.53@tcp:4:lfs.0 Request processed in 435us (675us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787579444.777537:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 2 00002000:00100000:3.0:1787579444.777545:0:6715:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffffa0ce812a9c00 x1874412591712512/t4294967305(0) o4->963d8c17-1326-491b-be60-9002b9296555@192.168.206.53@tcp:685/0 lens 504/448 e 0 to 0 dl 1787579455 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787579444.777553:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0ce812a9c00 with x1874412591712512 ext(0->12) 00010000:00010000:3.0:1787579444.777559:0:6715:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002f583c61/0xb72beeaffa1b771d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d12b expref: 9 pid: 6711 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579444.777571:0:6715:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002f583c61/0xb72beeaffa1b771d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d12b expref: 9 pid: 6711 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787579444.777578:0:6715:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa0ce812a9c00 00000100:00100000:2.0:1787579444.780245:0:6712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba82e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6712:1874412616880640:192.168.206.53@tcp:104: 00010000:00010000:2.0:1787579444.780273:0:6712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000076945f3f/0xb72beeaffa1b776a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579444.780983:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579444.781077:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591712640 00000100:00100000:0.0:1787579444.781084:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591712640 00010000:00010000:0.0:1787579444.781114:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002f583c61/0xb72beeaffa1b771d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d12b expref: 9 pid: 6711 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579444.781201:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 63 00000100:00100000:0.0:1787579444.781210:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+9:2361:x1874412591712640:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579444.781224:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787579444.781240:0:5850:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787579444.781243:0:5850:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787579443 00002000:00010000:0.0:1787579444.781245:0:5850:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787579444 00002000:00010000:0.0:1787579444.781248:0:5850:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787579443 00010000:00010000:0.0:1787579444.781253:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002f583c61/0xb72beeaffa1b771d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d12b expref: 9 pid: 6711 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.781266:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002f583c61/0xb72beeaffa1b771d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d12b expref: 9 pid: 6711 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.781287:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f583c61/0xb72beeaffa1b771d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d12b expref: 9 pid: 6711 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.781301:0:5850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787579444.781305:0:5850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787579444.781311:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076945f3f/0xb72beeaffa1b776a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.781320:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076945f3f/0xb72beeaffa1b776a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.781350:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579444.781400:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+8:2361:x1874412591712640:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 190us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579444.781407:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 63 00010000:00010000:1.0:1787579444.781565:0:6712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000076945f3f/0xb72beeaffa1b776a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579444.781575:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076945f3f/0xb72beeaffa1b776a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579444.781602:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076945f3f/0xb72beeaffa1b776a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579444.781611:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076945f3f/0xb72beeaffa1b776a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579444.781619:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076945f3f/0xb72beeaffa1b776a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579444.781625:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318000 already unused, calling callback (ffffffffc1654230) 00010000:00010000:1.0:1787579444.781635:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076945f3f/0xb72beeaffa1b776a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579444.781644:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076945f3f/0xb72beeaffa1b776a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579444.781656:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076945f3f/0xb72beeaffa1b776a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579444.781672:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076945f3f/0xb72beeaffa1b776a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579444.781725:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+7:2361:x1874412591712384:12345-192.168.206.53@tcp:1:lfs.0 Request processed in 9385us (9547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579444.781733:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 51 00000100:00100000:1.0:1787579444.784477:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579444.784554:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591712896 00000100:00100000:3.0:1787579444.784563:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591712896 00000100:00100000:3.0:1787579444.784624:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 38 00000100:00100000:3.0:1787579444.784634:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce9c707050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+24:11392:x1874412591712896:12345-192.168.206.53@tcp:35:lfs.0 00000004:00010000:3.0:1787579444.784697:0:5870:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b775c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d147 expref: 24 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787579444.784990:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1787579444.785036:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1787579444.785503:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1787579444.785555:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7771 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579444.785570:0:5870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b7708 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d11d expref: 28 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579444.785589:0:5870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7771 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579444.785623:0:5870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b7708 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d11d expref: 28 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579444.785637:0:5870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b7708 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d11d expref: 28 pid: 5868 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579444.785651:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4694a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5870:1874412616880768:192.168.206.53@tcp:104: 00000100:00100000:3.0:1787579444.785728:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84d07780 going to sleep for 11 seconds 00000100:00100000:3.0:1787579444.789318:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579444.789382:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4694a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5870:1874412616880768:192.168.206.53@tcp:104: 00010000:00010000:1.0:1787579444.789407:0:5870:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7771 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579444.790378:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591713024 00000100:00100000:2.0:1787579444.790388:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591713024 00010000:00010000:2.0:1787579444.790425:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b7708 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d11d expref: 29 pid: 5868 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579444.790466:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 64 00000100:00100000:2.0:1787579444.790476:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+29:2359:x1874412591713024:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787579444.790489:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579444.790495:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b7708 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d11d expref: 29 pid: 5868 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.790506:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b7708 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d11d expref: 29 pid: 5868 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.790526:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b7708 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d11d expref: 29 pid: 5868 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.790540:0:8477:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb900) 00010000:00010000:2.0:1787579444.790557:0:8477:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7771 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.790567:0:8477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7771 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.790574:0:8477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7771 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.790607:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579444.790656:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+28:2359:x1874412591713024:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 181us (1346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579444.790677:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 64 00010000:00010000:2.0:1787579444.791045:0:5870:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7771 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579444.791054:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7771 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787579444.791163:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1787579444.791348:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1787579444.791453:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba82e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5870:1874412616880896:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787579444.791500:0:5870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579444.791523:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceba43dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787579444.791544:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616880896 00000100:00100000:2.0:1787579444.791549:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616880896 00000100:00100000:2.0:1787579444.791585:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787579444.791593:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5870:x1874412616880896:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787579444.791655:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5870:x1874412616880896:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 63us (154us total) trans 0 rc 0/0 00000100:00080000:0.0:1787579444.792342:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787579444.792861:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787579444.793124:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba82e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5870:1874412616880896:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787579444.793548:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1787579444.793625:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba82e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5870:1874412616881024:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787579444.794278:0:5870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579444.794396:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceba43d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787579444.794440:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616881024 00000100:00100000:0.0:1787579444.794447:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616881024 00000100:00100000:0.0:1787579444.794516:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787579444.794525:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5870:x1874412616881024:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787579444.794754:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5870:x1874412616881024:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 229us (476us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787579444.794761:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787579444.794835:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba82e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5870:1874412616881024:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787579444.794903:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1787579444.794963:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7771 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579444.794973:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7771 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579444.794981:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7771 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579444.794987:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8a800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579444.794991:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7771 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579444.795010:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7771 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579444.795025:0:5870:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb900) 00010000:00010000:3.0:1787579444.795028:0:5870:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787579444.795032:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7771 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579444.795039:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7771 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787579444.795206:0:5870:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787579444.795294:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1787579444.795303:0:5870:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 380986376638ns, next at 381986374829ns, rc = 0 00000001:00080000:3.0:1787579444.795309:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1787579444.795337:0:5870:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb900) 00010000:00010000:3.0:1787579444.795340:0:5870:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787579444.795348:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b775c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d147 expref: 32 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579444.795441:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce9c707050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+31:11392:x1874412591712896:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 10808us (10971us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1787579444.795449:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 38 00000020:00080000:3.0:1787579444.795452:0:5870:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787579444.799350:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579444.799427:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591713152 00000100:00100000:0.0:1787579444.799436:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591713152 00000100:00100000:0.0:1787579444.799514:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 148 00000100:00100000:0.0:1787579444.799524:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+31:11392:x1874412591713152:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1787579444.799545:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579444.799566:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7778 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d14e expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.799630:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7778 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d14e expref: 32 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.799645:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7778 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d14e expref: 32 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.799675:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:0.0:1787579444.799679:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787579444.799695:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c9600, rc 0) 00000100:00100000:0.0:1787579444.799760:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+32:11392:x1874412591713152:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 237us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579444.799766:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 148 00000100:00100000:1.0:1787579444.805428:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579444.805509:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591713408 00000100:00100000:3.0:1787579444.805520:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591713408 00000100:00100000:3.0:1787579444.805575:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 39 00000100:00100000:3.0:1787579444.805595:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+32:11392:x1874412591713408:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:3.0:1787579444.805853:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+33:11392:x1874412591713408:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 260us (432us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1787579444.805861:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 39 00000100:00100000:1.0:1787579444.949416:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579444.949505:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591713664 00000100:00100000:0.0:1787579444.949516:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591713664 00000100:00100000:0.0:1787579444.949575:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 149 00000100:00100000:0.0:1787579444.949585:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+33:11402:x1874412591713664:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1787579444.949606:0:9532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579444.949624:0:9532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b777f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d155 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579444.949724:0:9532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787579444.949849:0:9532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b777f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d155 expref: 35 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.949865:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce82cbb500) 00010000:00010000:0.0:1787579444.949868:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787579444.949873:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b777f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d155 expref: 35 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.949885:0:9532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c8e00, rc 0) 00000100:00100000:0.0:1787579444.949987:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+34:11402:x1874412591713664:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 402us (580us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1787579444.949994:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 149 00000100:00100000:1.0:1787579444.954253:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579444.954396:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591713792 00000100:00100000:0.0:1787579444.954407:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591713792 00000100:00100000:0.0:1787579444.954463:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 150 00000100:00100000:0.0:1787579444.954487:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+34:11402:x1874412591713792:12345-192.168.206.53@tcp:34:lfs.0 00010000:00010000:0.0:1787579444.954560:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b778d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.954575:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b778d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.954587:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b778d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.954601:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7794 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.954609:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.954616:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.954704:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b779b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.954713:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b779b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.954721:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b779b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787579444.955037:0:5866:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b779b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.955050:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b778d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.955064:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b778d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.955070:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b778d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.955076:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579444.955080:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b778d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.955088:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b778d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.955101:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:0.0:1787579444.955104:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579444.955108:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b778d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.955115:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b778d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.955128:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.955134:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7794 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.955140:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7794 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.955145:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579444.955154:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7794 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.955160:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7794 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.955168:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0ce82cbbb00) 00010000:00010000:0.0:1787579444.955171:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579444.955174:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7794 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.955181:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7794 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.955195:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b779b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.955201:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b779b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.955206:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b779b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.955211:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579444.955214:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b779b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.955220:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b779b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.955228:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:0.0:1787579444.955230:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579444.955239:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b779b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579444.955246:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b779b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579444.955918:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+34:11402:x1874412591713792:12345-192.168.206.53@tcp:34:lfs.0 Request processed in 1431us (1671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579444.955969:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 150 00000100:00100000:1.0:1787579444.969909:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579444.976040:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591714048 00000100:00100000:2.0:1787579444.976054:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591714048 00000100:00100000:2.0:1787579444.976133:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 40 00000100:00100000:2.0:1787579444.976143:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+34:11402:x1874412591714048:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:2.0:1787579444.976417:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+35:11402:x1874412591714048:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 275us (6515us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1787579444.976425:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 40 00000100:00100000:1.0:1787579445.029986:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579445.030180:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591714304 00000100:00100000:0.0:1787579445.030190:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591714304 00000100:00100000:0.0:1787579445.030249:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 151 00000100:00100000:0.0:1787579445.030259:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+35:11405:x1874412591714304:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1787579445.030282:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579445.030314:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b77a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d15c expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.030383:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b77a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.030396:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b77a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.030406:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b77a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.030422:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b77b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.030429:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b77b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.030453:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b77b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.030571:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b77b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.030579:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b77b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.030587:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b77b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579445.030597:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787579445.030690:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b77a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.030698:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b77a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.030704:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b77a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.030710:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579445.030714:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b77a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.030722:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b77a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.030752:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:0.0:1787579445.030755:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579445.030767:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b77a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.030774:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b77a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.030787:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b77b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.030794:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b77b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.030799:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b77b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.030804:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579445.030807:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b77b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.030825:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b77b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.030833:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0ce82cbbb00) 00010000:00010000:0.0:1787579445.030835:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579445.030838:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b77b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.030843:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b77b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.030881:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b77a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d15c expref: 38 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.030908:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b77b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d15c expref: 37 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.030916:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:0.0:1787579445.030918:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787579445.030921:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c9400, rc 0) 00000100:00100000:0.0:1787579445.031027:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+37:11405:x1874412591714304:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 769us (1049us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1787579445.031035:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 151 00000100:00100000:1.0:1787579445.033816:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579445.033895:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591714432 00000100:00100000:2.0:1787579445.033905:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591714432 00000100:00100000:2.0:1787579445.033980:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 152 00000100:00100000:2.0:1787579445.033991:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+37:11405:x1874412591714432:12345-192.168.206.53@tcp:54:lfs.0 00010000:00010000:2.0:1787579445.034050:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b77c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579445.034066:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b77c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579445.034078:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b77c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579445.034103:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b77c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579445.034121:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b77c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579445.034128:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b77c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579445.034134:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579445.034138:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b77c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579445.034145:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b77c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579445.034157:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:2.0:1787579445.034161:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787579445.034165:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b77c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579445.034171:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b77c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579445.034245:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+37:11405:x1874412591714432:12345-192.168.206.53@tcp:54:lfs.0 Request processed in 256us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579445.034253:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 152 00000100:00100000:1.0:1787579445.039699:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579445.041643:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591714688 00000100:00100000:2.0:1787579445.041658:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591714688 00000100:00100000:2.0:1787579445.041719:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 41 00000100:00100000:2.0:1787579445.041729:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+37:11405:x1874412591714688:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:2.0:1787579445.041996:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+38:11405:x1874412591714688:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 267us (2305us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1787579445.042015:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 41 00000100:00100000:1.0:1787579445.328634:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579445.328821:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591714944 00000100:00100000:0.0:1787579445.328831:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591714944 00000100:00100000:0.0:1787579445.328946:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 153 00000100:00100000:0.0:1787579445.328957:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+38:11436:x1874412591714944:12345-192.168.206.53@tcp:101:cat.0 00010000:00010000:0.0:1787579445.328979:0:5866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579445.328998:0:5866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b77cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d163 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.329165:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b77d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.329180:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b77d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.329191:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b77d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579445.329202:0:5866:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787579445.329323:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b77cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d163 expref: 41 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.329341:0:5866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b77d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d163 expref: 40 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.329350:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:0.0:1787579445.329353:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787579445.329356:0:5866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c8e00, rc 0) 00000100:00100000:0.0:1787579445.329490:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+40:11436:x1874412591714944:12345-192.168.206.53@tcp:101:cat.0 Request processed in 533us (865us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1787579445.329497:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 153 00000100:00100000:1.0:1787579445.336380:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579445.338002:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579445.338092:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591715328 00000100:00100000:3.0:1787579445.338101:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591715328 00000100:00100000:3.0:1787579445.338172:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:3.0:1787579445.338183:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce831d4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+40:2361:x1874412591715328:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787579445.338197:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579445.338221:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b77d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d163 expref: 40 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.338237:0:8477:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:3.0:1787579445.338243:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579445.338298:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce831d4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+39:2361:x1874412591715328:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 116us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579445.338305:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:2.0:1787579445.338330:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591715200 00000100:00100000:2.0:1787579445.338335:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591715200 00000100:00100000:2.0:1787579445.338408:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 42 00000100:00100000:2.0:1787579445.338416:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+39:11436:x1874412591715200:12345-192.168.206.53@tcp:35:cat.0 00000100:00100000:2.0:1787579445.338681:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+40:11436:x1874412591715200:12345-192.168.206.53@tcp:35:cat.0 Request processed in 265us (2309us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1787579445.338688:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 42 00000100:00100000:1.0:1787579445.432609:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579445.432701:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591715584 00000100:00100000:0.0:1787579445.432715:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591715584 00000100:00100000:0.0:1787579445.432830:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 154 00000100:00100000:0.0:1787579445.432840:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+40:11442:x1874412591715584:12345-192.168.206.53@tcp:101:dd.0 00010000:00010000:0.0:1787579445.432861:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579445.432865:0:5868:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787579445.432889:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7739 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d139 expref: 40 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.432907:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:0.0:1787579445.432911:0:5868:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787579445.432960:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b77e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d16a expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.433047:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b77e8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.433076:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b77b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d15c expref: 40 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.433084:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b77e8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.433115:0:5868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b77b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d15c expref: 40 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.433128:0:5868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b77b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d15c expref: 40 pid: 5868 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579445.433142:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1abd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5868:1874412616881152:192.168.206.53@tcp:104: 00000100:00100000:0.0:1787579445.433229:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d11d900 going to sleep for 11 seconds 00000100:00100000:1.0:1787579445.436298:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579445.436381:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1abd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5868:1874412616881152:192.168.206.53@tcp:104: 00010000:00010000:0.0:1787579445.436417:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b77e8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579445.436514:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591715712 00000100:00100000:3.0:1787579445.436521:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591715712 00010000:00010000:3.0:1787579445.436553:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b77b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d15c expref: 41 pid: 5868 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579445.436588:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 65 00000100:00100000:3.0:1787579445.436606:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf306a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+41:2360:x1874412591715712:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787579445.436619:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579445.436626:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b77b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d15c expref: 41 pid: 5868 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.436654:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b77b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d15c expref: 41 pid: 5868 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.436674:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b77b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d15c expref: 41 pid: 5868 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.436687:0:5851:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:3.0:1787579445.436692:0:5851:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b77e8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.436700:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b77e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.436707:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b77e8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.436729:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579445.436782:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf306a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+40:2360:x1874412591715712:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 177us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579445.436789:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 65 00010000:00010000:0.0:1787579445.437069:0:5868:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b77e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.437076:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b77e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579445.437094:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787579445.437223:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b77e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d16a expref: 41 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.437251:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b77e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d16a expref: 40 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.437258:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:0.0:1787579445.437261:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787579445.437263:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c9200, rc 0) 00000100:00100000:0.0:1787579445.437306:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+40:11442:x1874412591715584:12345-192.168.206.53@tcp:101:dd.0 Request processed in 4468us (4707us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1787579445.437313:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 154 00000100:00100000:1.0:1787579445.440823:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579445.440899:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591715968 00000100:00100000:0.0:1787579445.440908:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591715968 00000100:00100000:0.0:1787579445.440982:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 155 00000100:00100000:0.0:1787579445.440991:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+40:11442:x1874412591715968:12345-192.168.206.53@tcp:36:dd.0 00010000:00010000:0.0:1787579445.441236:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b77f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.441254:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b77f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.441264:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b77f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787579445.441311:0:9530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1787579445.441335:0:9530:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8313d39 reply state 00000000dd6b0d4e transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b77f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579445.441343:0:9530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787579445.441724:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+43:11442:x1874412591715968:12345-192.168.206.53@tcp:36:dd.0 Request processed in 731us (917us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1787579445.441731:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 155 00000020:00080000:0.0:1787579445.441736:0:9530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787579445.443834:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b77f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579445.443849:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b77f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579445.443856:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b77f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579445.443862:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579445.443867:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b77f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579445.443875:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b77f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579445.443890:0:3306:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:2.0:1787579445.443894:0:3306:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579445.443897:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b77f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579445.443919:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b77f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.666839:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579445.749110:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579445.749252:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591716096 00000100:00100000:0.0:1787579445.749262:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591716096 00000100:00100000:0.0:1787579445.749325:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 156 00000100:00100000:0.0:1787579445.749346:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+42:11456:x1874412591716096:12345-192.168.206.53@tcp:101:stat.0 00010000:00010000:0.0:1787579445.749367:0:5866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579445.749387:0:5866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b77fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d171 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.749452:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7804 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.749465:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7804 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.749475:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7804 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.749490:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b780b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.749497:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b780b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.749515:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b780b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.749614:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7812 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.749637:0:5866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b77e8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d16a expref: 43 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.749645:0:5866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7812 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.749677:0:5866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b77e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d16a expref: 43 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.749690:0:5866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b77e8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d16a expref: 43 pid: 5868 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579445.749705:0:5866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1abd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5866:1874412616881280:192.168.206.53@tcp:104: 00000100:00100000:0.0:1787579445.749795:0:5866:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d11d000 going to sleep for 11 seconds 00000100:00100000:0.0:1787579445.756135:0:5866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1abd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5866:1874412616881280:192.168.206.53@tcp:104: 00010000:00010000:0.0:1787579445.756162:0:5866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7812 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579445.756674:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579445.758710:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591716352 00000100:00100000:0.0:1787579445.758724:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591716352 00000100:00100000:0.0:1787579445.758859:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 43 00000100:00100000:0.0:1787579445.758871:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+44:5600:x1874412591716352:12345-192.168.206.53@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787579445.759308:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+45:5600:x1874412591716352:12345-192.168.206.53@tcp:35:ldlm_bl.0 Request processed in 342us (2547us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1787579445.759319:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 43 00000100:00100000:1.0:1787579445.763906:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579445.764412:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591716480 00000100:00100000:3.0:1787579445.764421:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591716480 00010000:00010000:3.0:1787579445.764455:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b77e8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d16a expref: 45 pid: 5868 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579445.764493:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 66 00000100:00100000:3.0:1787579445.764502:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1768380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+45:2360:x1874412591716480:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787579445.764529:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579445.764535:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b77e8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d16a expref: 45 pid: 5868 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.764548:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b77e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d16a expref: 45 pid: 5868 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.764568:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b77e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d16a expref: 45 pid: 5868 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.764590:0:5850:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:3.0:1787579445.764595:0:5850:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7812 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.764604:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7812 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.764611:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7812 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.764634:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579445.764676:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1768380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+44:2360:x1874412591716480:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 175us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579445.764683:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 66 00010000:00010000:3.0:1787579445.764706:0:5866:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7812 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.764713:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7812 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579445.766477:0:5866:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787579445.766485:0:5866:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787579445.766512:0:5866:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7812 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.766527:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7812 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.766537:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7804 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.766544:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7804 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.766551:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7804 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.766557:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579445.766561:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7804 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.766568:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7804 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.766579:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:3.0:1787579445.766582:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579445.766586:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7804 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.766592:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7804 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.766617:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b780b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.766623:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b780b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.766629:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b780b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.766633:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579445.766636:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b780b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.766642:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b780b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.766649:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0ce82cbbb00) 00010000:00010000:3.0:1787579445.766651:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579445.766653:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b780b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.766659:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b780b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.766694:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b77fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d171 expref: 44 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.766706:0:5866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7812 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d171 expref: 43 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.766722:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:3.0:1787579445.766724:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787579445.766727:0:5866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c9400, rc 0) 00000100:00100000:3.0:1787579445.766776:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+43:11456:x1874412591716096:12345-192.168.206.53@tcp:101:stat.0 Request processed in 17443us (17676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579445.766783:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 156 00000100:00100000:1.0:1787579445.841401:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579445.842258:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591716736 00000100:00100000:0.0:1787579445.842281:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591716736 00000100:00100000:0.0:1787579445.842428:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 157 00000100:00100000:0.0:1787579445.842439:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec176b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+43:11462:x1874412591716736:12345-192.168.206.53@tcp:36:truncate.0 00010000:00010000:0.0:1787579445.842507:0:5868:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579445.842534:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7812 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d171 expref: 43 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.842551:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:0.0:1787579445.842556:0:5868:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787579445.843232:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7819 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.843249:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7819 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579445.843259:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7819 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787579445.843382:0:5868:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1787579445.843409:0:5868:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8b16195 reply state 00000000c822742a transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7819 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579445.843417:0:5868:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787579445.843530:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec176b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+45:11462:x1874412591716736:12345-192.168.206.53@tcp:36:truncate.0 Request processed in 1091us (2137us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1787579445.843538:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 157 00000020:00080000:0.0:1787579445.843543:0:5868:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787579445.845673:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7819 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579445.845686:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7819 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579445.845694:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7819 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579445.845699:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579445.845704:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7819 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579445.845712:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7819 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579445.845728:0:3305:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:2.0:1787579445.845731:0:3305:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579445.845735:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7819 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579445.845741:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7819 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579445.938445:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579445.938488:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579445.938517:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579445.938556:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579445.938594:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591717248 00000100:00100000:1.0:1787579445.938603:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591717248 00000100:00100000:1.0:1787579445.938653:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 142 00000100:00100000:1.0:1787579445.938662:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2362:x1874412591717248:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579445.938730:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2362:x1874412591717248:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 68us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579445.938738:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 142 00000100:00100000:2.0:1787579445.938972:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591717120 00000100:00100000:2.0:1787579445.938978:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591717120 00000100:00100000:2.0:1787579445.939018:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591716992 00000100:00100000:2.0:1787579445.939021:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591716992 00000100:00100000:2.0:1787579445.939055:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 65 00000100:00100000:2.0:1787579445.939062:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+6:2362:x1874412591717120:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1787579445.939095:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+6:2362:x1874412591717120:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 34us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579445.939103:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 65 00000100:00100000:2.0:1787579445.939115:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 66 00000100:00100000:2.0:1787579445.939121:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec176aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+7:2362:x1874412591716992:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1787579445.939145:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec176aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+7:2362:x1874412591716992:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 24us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579445.939151:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 66 00000100:00100000:3.0:1787579445.939325:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591716864 00000100:00100000:3.0:1787579445.939329:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591716864 00000100:00100000:3.0:1787579445.939363:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 291 00000100:00100000:3.0:1787579445.939371:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+13:2362:x1874412591716864:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1787579445.939398:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+13:2362:x1874412591716864:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 29us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579445.939405:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 291 00000100:00080000:1.0:1787579445.939717:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787579445.993844:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579445.993990:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591717376 00000100:00100000:3.0:1787579445.994004:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591717376 00000100:00100000:3.0:1787579445.994081:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 158 00000100:00100000:3.0:1787579445.994093:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+44:11476:x1874412591717376:12345-192.168.206.53@tcp:101:stat.0 00010000:00010000:3.0:1787579445.994123:0:5866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579445.994151:0:5866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7820 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d178 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.994238:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7827 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.994254:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7827 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.994287:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7827 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.994305:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8be00/0xb72beeaffa1b782e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.994313:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8be00/0xb72beeaffa1b782e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.994321:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8be00/0xb72beeaffa1b782e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.994442:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7835 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.994451:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.994457:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579445.994498:0:5866:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1787579445.994503:0:5866:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787579445.994526:0:5866:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.994539:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.994548:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7827 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.994565:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7827 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.994572:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7827 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.994715:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8b000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579445.994722:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7827 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.994731:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7827 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.994822:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:3.0:1787579445.994826:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579445.994832:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7827 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.994838:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7827 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.994854:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8be00/0xb72beeaffa1b782e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.994860:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8be00/0xb72beeaffa1b782e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.994865:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8be00/0xb72beeaffa1b782e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.994870:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8be00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579445.994880:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8be00/0xb72beeaffa1b782e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.994887:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8be00/0xb72beeaffa1b782e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.994895:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0ce84d55d00) 00010000:00010000:3.0:1787579445.994898:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579445.994901:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8be00/0xb72beeaffa1b782e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.994907:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8be00/0xb72beeaffa1b782e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.995204:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7820 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d178 expref: 46 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.995224:0:5866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7835 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d178 expref: 45 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579445.995233:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:3.0:1787579445.995236:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787579445.995239:0:5866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce90a8ba00, rc 0) 00000100:00100000:3.0:1787579445.995322:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+45:11476:x1874412591717376:12345-192.168.206.53@tcp:101:stat.0 Request processed in 1230us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579445.995331:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 158 00000100:00100000:3.0:1787579446.075562:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579446.075705:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591717632 00000100:00100000:0.0:1787579446.075718:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591717632 00000100:00100000:0.0:1787579446.075885:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 159 00000100:00100000:0.0:1787579446.075916:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+45:11486:x1874412591717632:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1787579446.075975:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579446.076005:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b783c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d17f expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579446.076176:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787579446.076348:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b783c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d17f expref: 47 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.076374:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce82cbb500) 00010000:00010000:0.0:1787579446.076378:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787579446.076384:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b783c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d17f expref: 47 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.076400:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c9400, rc 0) 00000100:00100000:0.0:1787579446.076481:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+46:11486:x1874412591717632:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 569us (932us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1787579446.076490:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 159 00000100:00080000:1.0:1787579446.076975:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787579446.080076:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579446.080498:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591717888 00000100:00100000:3.0:1787579446.080512:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591717888 00000100:00100000:3.0:1787579446.080586:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 44 00000100:00100000:3.0:1787579446.080618:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce9c704c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+46:11486:x1874412591717888:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:3.0:1787579446.080990:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce9c704c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+47:11486:x1874412591717888:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 373us (941us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1787579446.080998:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 44 00000100:00100000:3.0:1787579446.154171:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579446.154482:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591718144 00000100:00100000:1.0:1787579446.154495:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591718144 00000100:00100000:1.0:1787579446.154565:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 160 00000100:00100000:1.0:1787579446.154576:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+47:11492:x1874412591718144:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:1.0:1787579446.154624:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579446.154666:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9e00/0xb72beeaffa1b784a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d186 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579446.154800:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7851 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579446.154828:0:5867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7835 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d178 expref: 48 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579446.154838:0:5867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7851 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579446.154879:0:5867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7835 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d178 expref: 48 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579446.154894:0:5867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7835 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d178 expref: 48 pid: 5866 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579446.154911:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec176b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5867:1874412616881408:192.168.206.53@tcp:104: 00000100:00100000:1.0:1787579446.155083:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d375e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787579446.157887:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579446.158120:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591718272 00000100:00100000:3.0:1787579446.158131:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591718272 00010000:00010000:3.0:1787579446.158179:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7835 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d178 expref: 49 pid: 5866 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579446.158221:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 67 00000100:00100000:3.0:1787579446.158230:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+49:2360:x1874412591718272:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787579446.158247:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579446.158254:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7835 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d178 expref: 49 pid: 5866 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579446.158269:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7835 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d178 expref: 49 pid: 5866 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579446.158295:0:5851:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:3.0:1787579446.158301:0:5851:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7851 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579446.158312:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7851 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579446.158321:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7851 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579446.158355:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579446.158428:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+49:2360:x1874412591718272:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 199us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579446.158437:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 67 00010000:00010000:2.0:1787579446.159567:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7835 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d178 expref: 48 pid: 5866 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579446.159605:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec176b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5867:1874412616881408:192.168.206.53@tcp:104: 00010000:00010000:2.0:1787579446.159636:0:5867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7851 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.159646:0:5867:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7851 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.159652:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7851 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579446.159676:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1787579446.160144:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9e00/0xb72beeaffa1b784a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d186 expref: 49 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.160186:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7851 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d186 expref: 48 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.160195:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:2.0:1787579446.160198:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787579446.160201:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb47c9400, rc 0) 00000100:00100000:2.0:1787579446.160281:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+48:11492:x1874412591718144:12345-192.168.206.53@tcp:101:bash.0 Request processed in 5706us (6123us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1787579446.160290:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 160 00000100:00100000:1.0:1787579446.163312:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579446.163869:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591718528 00000100:00100000:0.0:1787579446.164097:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591718528 00000100:00100000:0.0:1787579446.164170:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 161 00000100:00100000:0.0:1787579446.164180:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+48:11492:x1874412591718528:12345-192.168.206.53@tcp:36:bash.0 00010000:00010000:0.0:1787579446.164786:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b785f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.164816:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b785f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.164850:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b785f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787579446.165155:0:9532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1787579446.165182:0:9532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000258376c8 reply state 000000007314b349 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b785f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579446.165192:0:9532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787579446.165356:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+51:11492:x1874412591718528:12345-192.168.206.53@tcp:36:bash.0 Request processed in 1174us (2054us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1787579446.165365:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 161 00000020:00080000:0.0:1787579446.165371:0:9532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787579446.170938:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b785f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579446.170962:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b785f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579446.170994:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b785f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579446.171000:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9a00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579446.171007:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b785f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579446.171015:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b785f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579446.171038:0:3306:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:1.0:1787579446.171042:0:3306:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579446.171047:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b785f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579446.171054:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b785f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579446.175281:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579446.175462:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591718656 00000100:00100000:2.0:1787579446.175475:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591718656 00000100:00100000:2.0:1787579446.175586:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 162 00000100:00100000:2.0:1787579446.175599:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec176bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+50:11492:x1874412591718656:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:2.0:1787579446.175632:0:9530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579446.175660:0:9530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318200/0xb72beeaffa1b7866 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d18d expref: -99 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.175784:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b786d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.175811:0:9530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7851 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d186 expref: 51 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.175821:0:9530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b786d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.175864:0:9530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7851 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d186 expref: 51 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.176084:0:9530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7851 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d186 expref: 51 pid: 5867 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579446.176100:0:9530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba315500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9530:1874412616881536:192.168.206.53@tcp:104: 00000100:00100000:2.0:1787579446.176201:0:9530:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceba43d540 going to sleep for 11 seconds 00000100:00100000:1.0:1787579446.180317:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579446.180741:0:9530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba315500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9530:1874412616881536:192.168.206.53@tcp:104: 00010000:00010000:2.0:1787579446.180785:0:9530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b786d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579446.181086:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591718784 00000100:00100000:3.0:1787579446.181096:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591718784 00010000:00010000:3.0:1787579446.181144:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7851 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d186 expref: 52 pid: 5867 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579446.181225:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 68 00000100:00100000:3.0:1787579446.181237:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec176ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+52:2359:x1874412591718784:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787579446.181255:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579446.181264:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7851 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d186 expref: 52 pid: 5867 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579446.181278:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7851 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d186 expref: 52 pid: 5867 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579446.181307:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7851 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d186 expref: 52 pid: 5867 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579446.181326:0:5850:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:3.0:1787579446.181332:0:5850:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b786d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579446.181342:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b786d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579446.181374:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b786d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579446.181416:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579446.181497:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec176ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+51:2359:x1874412591718784:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 262us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579446.181506:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 68 00010000:00010000:2.0:1787579446.181567:0:9530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b786d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.181586:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b786d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579446.181646:0:9530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787579446.181652:0:9530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787579446.181681:0:9530:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b786d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.181719:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318200/0xb72beeaffa1b7866 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d18d expref: 51 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.181750:0:9530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b786d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d18d expref: 50 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.181759:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:2.0:1787579446.181770:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787579446.181773:0:9530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319c00, rc 0) 00000100:00100000:2.0:1787579446.181815:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec176bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+50:11492:x1874412591718656:12345-192.168.206.53@tcp:101:bash.0 Request processed in 6209us (6539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579446.181823:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 162 00000100:00100000:0.0:1787579446.185679:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579446.185819:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591719040 00000100:00100000:3.0:1787579446.185830:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591719040 00000100:00100000:3.0:1787579446.186053:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 45 00000100:00100000:3.0:1787579446.186065:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+50:11492:x1874412591719040:12345-192.168.206.53@tcp:35:bash.0 00000100:00100000:3.0:1787579446.186342:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+51:11492:x1874412591719040:12345-192.168.206.53@tcp:35:bash.0 Request processed in 279us (675us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1787579446.186350:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 45 00000100:00100000:0.0:1787579446.241924:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787579446.241976:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebf291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616881664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787579446.242076:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579446.242175:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616881664 00000100:00100000:0.0:1787579446.242185:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616881664 00000100:00100000:0.0:1787579446.242257:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787579446.242268:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616881664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787579446.242312:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579446.242365:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616881664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579446.242372:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787579446.242445:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebf291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616881664:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787579446.242622:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787579446.242837:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1874412616882048:0@lo:400:kworker.0 00000100:00100000:2.0:1787579446.242884:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579446.242911:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787579446.242917:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874412616881920:0@lo:400:kworker.0 00000100:00100000:2.0:1787579446.242965:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579446.243047:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616881792:0@lo:400:kworker.0 00000100:00100000:0.0:1787579446.243091:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579446.243115:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3322:1874412616882304:0@lo:400:kworker.0 00000100:00100000:0.0:1787579446.251065:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616882176:0@lo:400:kworker.0 00000100:00100000:0.0:1787579446.251178:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579446.251356:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616881792 00000100:00100000:1.0:1787579446.251368:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616881792 00000100:00100000:1.0:1787579446.251507:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787579446.251518:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3322:x1874412616881792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579446.254061:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616882048 00000100:00100000:3.0:1787579446.254081:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616882048 00000100:00100000:3.0:1787579446.254171:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616881920 00000100:00100000:3.0:1787579446.254174:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616881920 00000100:00100000:3.0:1787579446.254198:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787579446.254208:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874412616882048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579446.266072:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3322:x1874412616881792:12345-0@lo:400:kworker.0 Request processed in 14540us (22963us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579446.266090:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00080000:1.0:1787579446.266176:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579446.266256:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787579446.266271:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874412616881920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579446.266355:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874412616881920:12345-0@lo:400:kworker.0 Request processed in 89us (23389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579446.266361:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787579446.266403:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616882176 00000100:00100000:1.0:1787579446.266413:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616882176 00000100:00100000:1.0:1787579446.266476:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787579446.266483:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3321:x1874412616882176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579446.266520:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3321:x1874412616882176:12345-0@lo:400:kworker.0 Request processed in 39us (15343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579446.266526:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1787579446.266538:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787579446.266595:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616882176:0@lo:400:kworker.0 00000100:00100000:0.0:1787579446.267478:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579446.267542:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616881792:0@lo:400:kworker.0 00000100:00100000:1.0:1787579446.268923:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616882304 00000100:00100000:1.0:1787579446.268975:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616882304 00000100:00100000:1.0:1787579446.269054:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787579446.269064:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb468b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1874412616882304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579446.269169:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb468b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1874412616882304:12345-0@lo:400:kworker.0 Request processed in 106us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579446.269178:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:0.0:1787579446.269476:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579446.269519:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3322:1874412616882304:0@lo:400:kworker.0 00000100:00100000:3.0:1787579446.269658:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874412616882048:12345-0@lo:400:kworker.0 Request processed in 15449us (26771us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579446.269667:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787579446.274869:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874412616881920:0@lo:400:kworker.0 00000100:00100000:2.0:1787579446.275182:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1874412616882048:0@lo:400:kworker.0 00000100:00100000:0.0:1787579446.291766:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579446.291868:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591719296 00000100:00100000:1.0:1787579446.291892:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591719296 00000100:00100000:1.0:1787579446.291988:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 163 00000100:00100000:1.0:1787579446.292000:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+51:11502:x1874412591719296:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1787579446.292030:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579446.292087:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b7874 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d194 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787579446.292237:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787579446.292378:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b7874 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d194 expref: 53 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579446.292397:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce82cbb500) 00010000:00010000:1.0:1787579446.292400:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787579446.292406:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b7874 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d194 expref: 53 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579446.292421:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb47c8200, rc 0) 00000100:00100000:1.0:1787579446.292487:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+52:11502:x1874412591719296:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 489us (734us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1787579446.292495:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 163 00000100:00100000:0.0:1787579446.296352:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579446.296456:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591719424 00000100:00100000:1.0:1787579446.296469:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591719424 00000100:00100000:0.0:1787579446.296695:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 164 00000100:00100000:0.0:1787579446.296707:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+52:11502:x1874412591719424:12345-192.168.206.53@tcp:34:lfs.0 00010000:00010000:0.0:1787579446.297257:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7882 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.297276:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7882 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.297289:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7882 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.297305:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7889 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.297312:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7889 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.297318:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7889 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.297456:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7890 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.297466:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7890 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.297474:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7890 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787579446.297528:0:9530:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7890 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.297541:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7882 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.297547:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7882 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.297554:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7882 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.297560:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579446.297565:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7882 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.297721:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7882 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.297812:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:0.0:1787579446.297816:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579446.297821:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7882 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.297836:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7882 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.297851:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7889 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.297856:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7889 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.297861:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7889 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.297865:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579446.297869:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7889 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.298316:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7889 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.298327:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0ce82cbb800) 00010000:00010000:0.0:1787579446.298331:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579446.298334:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7889 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.298340:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7889 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.298360:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7890 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.298365:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7890 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.298382:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7890 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.298386:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579446.298389:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7890 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.298395:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7890 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.298404:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:0.0:1787579446.298406:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579446.298409:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7890 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.298414:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7890 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579446.298590:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+52:11502:x1874412591719424:12345-192.168.206.53@tcp:34:lfs.0 Request processed in 1871us (2238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579446.298602:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 164 00000100:00100000:2.0:1787579446.302464:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579446.302554:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591719680 00000100:00100000:0.0:1787579446.302567:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591719680 00000100:00100000:0.0:1787579446.302750:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 46 00000100:00100000:0.0:1787579446.302763:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+52:11502:x1874412591719680:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:0.0:1787579446.303413:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+53:11502:x1874412591719680:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 650us (961us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1787579446.303423:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 46 00000100:00100000:0.0:1787579446.337019:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579446.337277:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591719936 00000100:00100000:3.0:1787579446.337291:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591719936 00000100:00100000:3.0:1787579446.337353:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 165 00000100:00100000:3.0:1787579446.337366:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+53:11505:x1874412591719936:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1787579446.337415:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579446.337442:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7897 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d19b expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579446.337537:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8be00/0xb72beeaffa1b789e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579446.337555:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8be00/0xb72beeaffa1b789e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579446.337567:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8be00/0xb72beeaffa1b789e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579446.337596:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b78a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579446.337604:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b78a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579446.337612:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b78a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579446.337769:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b78ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579446.337779:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b78ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579446.337786:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b78ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579446.337797:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787579446.339009:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8be00/0xb72beeaffa1b789e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.339026:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8be00/0xb72beeaffa1b789e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.339034:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8be00/0xb72beeaffa1b789e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.339041:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8be00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579446.339047:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8be00/0xb72beeaffa1b789e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.339056:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8be00/0xb72beeaffa1b789e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.339247:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:2.0:1787579446.339251:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579446.339256:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8be00/0xb72beeaffa1b789e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.339264:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8be00/0xb72beeaffa1b789e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.339283:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b78a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.339289:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b78a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.339295:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b78a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.339300:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8b000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579446.339303:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b78a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.339310:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b78a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.339318:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0ce84d55b00) 00010000:00010000:2.0:1787579446.339321:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579446.339323:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b78a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.339329:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b78a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.339410:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7897 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d19b expref: 56 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.339430:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b78ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d19b expref: 55 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.339438:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:2.0:1787579446.339440:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787579446.339443:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce90a8bc00, rc 0) 00000100:00100000:2.0:1787579446.339542:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+55:11505:x1874412591719936:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 2177us (2538us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1787579446.339553:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 165 00000100:00100000:1.0:1787579446.343350:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579446.343508:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591720064 00000100:00100000:2.0:1787579446.343520:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591720064 00000100:00100000:2.0:1787579446.343601:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 166 00000100:00100000:2.0:1787579446.343612:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+55:11505:x1874412591720064:12345-192.168.206.53@tcp:54:lfs.0 00010000:00010000:2.0:1787579446.343704:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318200/0xb72beeaffa1b78ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.343725:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318200/0xb72beeaffa1b78ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.343749:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318200/0xb72beeaffa1b78ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.343785:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318200/0xb72beeaffa1b78ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.343824:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318200/0xb72beeaffa1b78ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.343831:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318200/0xb72beeaffa1b78ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.343838:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579446.343843:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318200/0xb72beeaffa1b78ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.343851:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318200/0xb72beeaffa1b78ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.343865:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:2.0:1787579446.343869:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787579446.343873:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318200/0xb72beeaffa1b78ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.343880:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318200/0xb72beeaffa1b78ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579446.344035:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+55:11505:x1874412591720064:12345-192.168.206.53@tcp:54:lfs.0 Request processed in 423us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579446.344045:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 166 00000100:00100000:0.0:1787579446.346849:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579446.347099:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591720320 00000100:00100000:3.0:1787579446.347111:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591720320 00000100:00100000:3.0:1787579446.347178:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 47 00000100:00100000:3.0:1787579446.347189:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+55:11505:x1874412591720320:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:3.0:1787579446.347631:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+56:11505:x1874412591720320:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 441us (793us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1787579446.347640:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 47 00000100:00100000:3.0:1787579446.352314:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579446.352386:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591720448 00000100:00100000:0.0:1787579446.352409:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591720448 00000100:00100000:0.0:1787579446.352499:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:0.0:1787579446.352510:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf291f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+56:2360:x1874412591720448:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579446.352530:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579446.352562:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b78ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d19b expref: 56 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579446.352586:0:5851:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:0.0:1787579446.352592:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579446.352651:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf291f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+55:2360:x1874412591720448:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 144us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579446.352659:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:0.0:1787579446.493541:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579446.493686:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591720704 00000100:00100000:2.0:1787579446.493699:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591720704 00000100:00100000:2.0:1787579446.493843:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 167 00000100:00100000:2.0:1787579446.493856:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+55:11524:x1874412591720704:12345-192.168.206.53@tcp:101:cat.0 00010000:00010000:2.0:1787579446.494203:0:9530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579446.494247:0:9530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318200/0xb72beeaffa1b78c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d1a2 expref: -99 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.494373:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b78c8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.494389:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b78c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.494402:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b78c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579446.494416:0:9530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787579446.494583:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318200/0xb72beeaffa1b78c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1a2 expref: 58 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.494606:0:9530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b78c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1a2 expref: 57 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.494615:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:2.0:1787579446.494619:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787579446.494622:0:9530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319a00, rc 0) 00000100:00100000:2.0:1787579446.494813:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+57:11524:x1874412591720704:12345-192.168.206.53@tcp:101:cat.0 Request processed in 950us (1276us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1787579446.494823:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 167 00000100:00100000:1.0:1787579446.528047:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579446.528262:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591720832 00000100:00100000:2.0:1787579446.528275:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591720832 00000100:00100000:2.0:1787579446.528340:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 168 00000100:00100000:2.0:1787579446.528351:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec176a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+57:11525:x1874412591720832:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1787579446.528398:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579446.528425:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318200/0xb72beeaffa1b78d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d1a9 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.528509:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b78dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.528526:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b78dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.528539:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b78dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579446.528612:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787579446.528615:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787579446.528639:0:5868:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b78dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.528671:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318200/0xb72beeaffa1b78d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1a9 expref: 59 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.528690:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b78dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1a9 expref: 58 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.528700:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:2.0:1787579446.528703:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787579446.528707:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319200, rc 0) 00000100:00100000:2.0:1787579446.528771:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec176a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+58:11525:x1874412591720832:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 421us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579446.528779:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 168 00000100:00100000:0.0:1787579446.534675:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579446.534856:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591721216 00000100:00100000:3.0:1787579446.534868:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591721216 00000100:00100000:3.0:1787579446.535011:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 48 00000100:00100000:3.0:1787579446.535024:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+58:11525:x1874412591721216:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:3.0:1787579446.535918:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+59:11525:x1874412591721216:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 891us (1252us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787579446.536014:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 48 00000100:00100000:0.0:1787579446.540791:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579446.540905:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591721344 00000100:00100000:1.0:1787579446.540917:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591721344 00000100:00100000:1.0:1787579446.541021:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 13 00000100:00100000:1.0:1787579446.541044:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf836680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+59:11525:x1874412591721344:12345-192.168.206.53@tcp:103:lfs.0 00010000:00010000:1.0:1787579446.541273:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787579446.541306:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b786d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d18d expref: 59 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579446.541355:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b78c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1a2 expref: 58 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579446.541367:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7778 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d14e expref: 57 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579446.541378:0:8477:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbb100) 00010000:00010000:1.0:1787579446.541390:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787579446.541461:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf836680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+56:11525:x1874412591721344:12345-192.168.206.53@tcp:103:lfs.0 Request processed in 430us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579446.541469:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 13 00000100:00100000:1.0:1787579446.545157:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579446.545305:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591721472 00000100:00100000:2.0:1787579446.545317:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591721472 00000100:00100000:2.0:1787579446.545380:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 169 00000100:00100000:2.0:1787579446.545391:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+56:11525:x1874412591721472:12345-192.168.206.53@tcp:58:lfs.0 00010000:00010000:2.0:1787579446.545549:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318200/0xb72beeaffa1b78e4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.545569:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318200/0xb72beeaffa1b78e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.545593:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318200/0xb72beeaffa1b78e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787579446.545839:0:5867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1787579446.546028:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+56:11525:x1874412591721472:12345-192.168.206.53@tcp:58:lfs.0 Request processed in 637us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579446.546038:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 169 00000100:00100000:0.0:1787579446.564215:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579446.564330:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591721600 00000100:00100000:2.0:1787579446.564343:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591721600 00000100:00100000:2.0:1787579446.564415:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 170 00000100:00100000:2.0:1787579446.564429:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+56:11527:x1874412591721600:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1787579446.564466:0:9530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579446.564496:0:9530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b78eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d1b0 expref: -99 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.564593:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b78f2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.564609:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b78f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.564642:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b78f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.564660:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b78f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.564668:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b78f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.564675:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b78f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.564793:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7900 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.564814:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7900 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.564822:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7900 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579446.564864:0:9530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787579446.564869:0:9530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787579446.564892:0:9530:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7900 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.564905:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7900 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.564915:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b78f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.564984:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b78f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.564992:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b78f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.564998:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba319c00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579446.565003:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b78f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.565011:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b78f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.565025:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:2.0:1787579446.565029:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579446.565034:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b78f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.565041:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319c00/0xb72beeaffa1b78f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.565055:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b78f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.565061:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b78f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.565067:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b78f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.565072:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579446.565081:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b78f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.565088:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b78f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.565096:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0cea147d700) 00010000:00010000:2.0:1787579446.565099:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579446.565101:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b78f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.565107:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b78f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.565143:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b78eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1b0 expref: 58 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.565157:0:9530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7900 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1b0 expref: 57 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579446.565165:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0cea147da00) 00010000:00010000:2.0:1787579446.565168:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787579446.565171:0:9530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319e00, rc 0) 00000100:00100000:2.0:1787579446.565257:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+57:11527:x1874412591721600:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 832us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579446.565266:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 170 00010000:00010000:0.0:1787579446.691427:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579446.752144:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec176b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616882432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787579446.752239:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787579446.752363:0:7183:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 382943435127ns, next at 383943431127ns, rc = 0 00000100:00100000:3.0:1787579446.752432:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616882432 00000100:00100000:3.0:1787579446.752449:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616882432 00000100:00100000:3.0:1787579446.752532:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787579446.752545:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1874412616882432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787579446.752582:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787579446.755715:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1874412616882432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3164us (3466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579446.755730:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787579446.761152:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec176b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616882432:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1787579447.072231:0:11712:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787579447.072243:0:11712:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787579447.072448:0:11712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787579447.072469:0:11712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787579447.072615:0:11712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebf304000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11712:1874412616882560:192.168.206.53@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787579447.072740:0:11712:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cd833f59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787579447.075093:0:11712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebf304000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11712:1874412616882560:192.168.206.53@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787579447.076460:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579447.076682:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591721728 00000100:00100000:2.0:1787579447.076694:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591721728 00000100:00100000:2.0:1787579447.076769:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 171 00000100:00100000:2.0:1787579447.076781:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec176a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+57:11538:x1874412591721728:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787579447.076836:0:9532:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787579447.077011:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec176a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+57:11538:x1874412591721728:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 Request processed in 231us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579447.077019:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 171 00000100:00100000:3.0:1787579447.086107:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579447.086168:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591721856 00000100:00100000:0.0:1787579447.086181:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591721856 00000100:00100000:0.0:1787579447.086255:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 172 00000100:00100000:0.0:1787579447.086267:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+57:11538:x1874412591721856:12345-192.168.206.53@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787579447.086370:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7907 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.086391:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7907 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.086414:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7907 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.086431:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b790e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.086437:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b790e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.086443:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b790e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.086472:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7915 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.086480:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7915 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.086485:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7915 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579447.086528:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787579447.086532:0:5867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787579447.086545:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7915 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.086556:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7907 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.086561:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7907 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.086577:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7907 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.086584:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9600 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579447.086588:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7907 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.086596:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7907 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.086611:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0ce84d55300) 00010000:00010000:0.0:1787579447.086615:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579447.086620:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7907 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.086627:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7907 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.086639:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b790e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.086645:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b790e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.086651:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b790e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.086656:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579447.086658:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b790e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.086672:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b790e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.086679:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffffa0ce82cbb800) 00010000:00010000:0.0:1787579447.086681:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579447.086683:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b790e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.086688:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b790e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.086701:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7915 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.086706:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7915 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.086711:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7915 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.086714:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579447.086716:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7915 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.086720:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7915 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.086725:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0cea147da00) 00010000:00010000:0.0:1787579447.086726:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579447.086728:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7915 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.087295:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7915 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579447.087394:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+57:11538:x1874412591721856:12345-192.168.206.53@tcp:34:lhsmtool_posix.0 Request processed in 1126us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579447.087405:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 172 00000100:00100000:0.0:1787579447.091547:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579447.091698:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591722112 00000100:00100000:3.0:1787579447.091712:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591722112 00000100:00100000:3.0:1787579447.095029:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 173 00000100:00100000:3.0:1787579447.095051:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+57:11538:x1874412591722112:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787579447.095077:0:9530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579447.095104:0:9530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b800/0xb72beeaffa1b791c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d1b7 expref: -99 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.095233:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a000/0xb72beeaffa1b7923 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.095251:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a000/0xb72beeaffa1b7923 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.095264:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a000/0xb72beeaffa1b7923 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579447.095278:0:9530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787579447.095394:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a000/0xb72beeaffa1b7923 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.095403:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a000/0xb72beeaffa1b7923 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.095410:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a000/0xb72beeaffa1b7923 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.095430:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8a000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579447.095436:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a000/0xb72beeaffa1b7923 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.095444:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a000/0xb72beeaffa1b7923 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.095459:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0cea147da00) 00010000:00010000:3.0:1787579447.095462:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787579447.095467:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a000/0xb72beeaffa1b7923 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.095473:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a000/0xb72beeaffa1b7923 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.095522:0:9530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b800/0xb72beeaffa1b791c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1b7 expref: 59 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.095533:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0ce84d55300) 00010000:00010000:3.0:1787579447.095535:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787579447.095539:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b800/0xb72beeaffa1b791c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1b7 expref: 59 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.095548:0:9530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce90a8b800, rc 0) 00000100:00100000:3.0:1787579447.095655:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+58:11538:x1874412591722112:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 611us (4120us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1787579447.095664:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 173 00000100:00100000:3.0:1787579447.098728:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579447.098840:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591722240 00000100:00100000:0.0:1787579447.098852:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591722240 00000100:00100000:0.0:1787579447.098950:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 174 00000100:00100000:0.0:1787579447.098963:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+58:11538:x1874412591722240:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787579447.099011:0:5866:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787579447.099140:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+58:11538:x1874412591722240:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 Request processed in 179us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579447.099148:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 174 00000100:00100000:3.0:1787579447.103445:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579447.103683:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591722496 00000100:00100000:0.0:1787579447.103696:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591722496 00000100:00100000:0.0:1787579447.103766:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 175 00000100:00100000:0.0:1787579447.103777:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec17c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+58:11538:x1874412591722496:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787579447.103814:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579447.103818:0:5867:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787579447.103852:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b78dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1a9 expref: 58 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.103872:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:0.0:1787579447.103877:0:5867:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787579447.103901:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7931 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d1be expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787579447.104409:0:5867:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1787579447.104909:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7938 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.105017:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7938 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.105030:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7938 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.105101:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7931 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1be expref: 60 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.105117:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7938 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1be expref: 59 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.105126:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0ce82cbb800) 00010000:00010000:0.0:1787579447.105129:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787579447.105132:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c9000, rc 0) 00000100:00100000:0.0:1787579447.105247:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec17c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+59:11538:x1874412591722496:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 1471us (1816us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1787579447.105257:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 175 00000100:00100000:2.0:1787579447.110814:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579447.110915:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591722752 00000100:00100000:0.0:1787579447.110976:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591722752 00000100:00100000:0.0:1787579447.111049:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 176 00000100:00100000:0.0:1787579447.111060:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+59:11538:x1874412591722752:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787579447.111174:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579447.111206:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7938 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1be expref: 59 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.111224:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0ce82cbb800) 00010000:00010000:0.0:1787579447.111235:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787579447.111264:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7946 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.111280:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7946 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.111289:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7946 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.121919:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b794d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xe4f0f53b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.122200:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b794d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe4f0f53b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.122212:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b794d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe4f0f53b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.122853:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7946 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.122863:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7946 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.122870:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7946 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.122890:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9600 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579447.122894:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7946 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.122901:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7946 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.122914:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:0.0:1787579447.122917:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579447.122922:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7946 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.123317:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7946 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.123331:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b794d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe4f0f53b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.123337:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b794d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe4f0f53b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.123343:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b794d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe4f0f53b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.123348:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579447.123351:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b794d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe4f0f53b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.123357:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b794d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe4f0f53b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.123376:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xe4f0f53b (ffffa0ce82cbbc00) 00010000:00010000:0.0:1787579447.123379:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579447.123382:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b794d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe4f0f53b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.123388:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b794d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe4f0f53b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579447.123550:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+58:11538:x1874412591722752:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 12487us (12758us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787579447.123558:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 176 00000100:00100000:3.0:1787579447.132714:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579447.133053:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591722880 00000100:00100000:2.0:1787579447.133070:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591722880 00000100:00100000:2.0:1787579447.133155:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 177 00000100:00100000:2.0:1787579447.133167:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+58:11538:x1874412591722880:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787579447.133192:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579447.133224:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7954 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d1c5 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.133268:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b795b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.133283:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b795b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.133297:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b795b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.133426:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7954 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1c5 expref: 60 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.133456:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b795b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1c5 expref: 59 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.133466:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0cea147d700) 00010000:00010000:2.0:1787579447.133470:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787579447.133474:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba318e00, rc 0) 00000100:00100000:2.0:1787579447.133557:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+59:11538:x1874412591722880:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 391us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579447.133564:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 177 00000100:00100000:2.0:1787579447.138476:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579447.138589:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591723136 00000100:00100000:3.0:1787579447.138604:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591723136 00000100:00100000:3.0:1787579447.138675:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 178 00000100:00100000:3.0:1787579447.138688:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+59:11538:x1874412591723136:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787579447.138767:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b800/0xb72beeaffa1b7962 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.138784:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b800/0xb72beeaffa1b7962 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.138795:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b800/0xb72beeaffa1b7962 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787579447.139136:0:9530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1787579447.139147:0:9530:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 383330219783ns, next at 384330217275ns, rc = 0 00000004:00010000:3.0:1787579447.139229:0:9530:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6635f35 reply state 00000000c5ea586b transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b800/0xb72beeaffa1b7962 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579447.139238:0:9530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787579447.139335:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+61:11538:x1874412591723136:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 649us (870us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1787579447.139342:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 178 00010000:00010000:0.0:1787579447.143977:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b800/0xb72beeaffa1b7962 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.144010:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b800/0xb72beeaffa1b7962 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.144019:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b800/0xb72beeaffa1b7962 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.144026:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8b800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579447.144032:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b800/0xb72beeaffa1b7962 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.144041:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b800/0xb72beeaffa1b7962 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.144063:0:3305:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0cea147d700) 00010000:00010000:0.0:1787579447.144066:0:3305:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787579447.144071:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b800/0xb72beeaffa1b7962 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.144095:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b800/0xb72beeaffa1b7962 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579447.156693:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579447.157752:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591723264 00000100:00100000:2.0:1787579447.157768:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591723264 00000100:00100000:2.0:1787579447.157853:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 179 00000100:00100000:2.0:1787579447.157866:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+60:11538:x1874412591723264:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787579447.157895:0:9532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579447.157921:0:9532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7969 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d1cc expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.158022:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7969 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1cc expref: 61 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.158039:0:9532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7969 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1cc expref: 61 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.158062:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0cea147d700) 00010000:00010000:2.0:1787579447.158082:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787579447.158087:0:9532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba318400, rc 0) 00000100:00100000:2.0:1787579447.158169:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+61:11538:x1874412591723264:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 304us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579447.158176:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 179 00000100:00100000:3.0:1787579447.167859:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579447.168039:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591723392 00000100:00100000:0.0:1787579447.168052:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591723392 00000100:00100000:0.0:1787579447.168145:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 52 00000100:00100000:0.0:1787579447.168158:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+6:2360:x1874412591723392:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787579447.168565:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+7:2360:x1874412591723392:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 Request processed in 408us (719us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787579447.168573:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 52 00000100:00080000:1.0:1787579447.169082:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787579447.174471:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579447.175900:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591723648 00000100:00100000:3.0:1787579447.175919:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591723648 00000100:00100000:3.0:1787579447.176043:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 49 00000100:00100000:3.0:1787579447.176056:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+61:11538:x1874412591723648:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787579447.176406:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+62:11538:x1874412591723648:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 Request processed in 351us (1949us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787579447.176415:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 49 00000100:00100000:0.0:1787579447.181614:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579447.181778:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591723904 00000100:00100000:1.0:1787579447.181795:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591723904 00000100:00100000:1.0:1787579447.181886:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 180 00000100:00100000:1.0:1787579447.181899:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+62:11538:x1874412591723904:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787579447.182058:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+62:11538:x1874412591723904:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 162us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579447.182067:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 180 00000100:00100000:3.0:1787579447.189325:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579447.189456:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591724032 00000100:00100000:2.0:1787579447.189478:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591724032 00000100:00100000:2.0:1787579447.189554:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 181 00000100:00100000:2.0:1787579447.189566:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+62:11538:x1874412591724032:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787579447.189592:0:9530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579447.189619:0:9530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7970 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d1d3 expref: -99 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.189734:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b7977 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.189750:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b7977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.189762:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b7977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579447.189818:0:9530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787579447.189842:0:9530:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b7977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.189873:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7970 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1d3 expref: 64 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.189894:0:9530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b7977 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1d3 expref: 63 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.189912:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0cea147d700) 00010000:00010000:2.0:1787579447.189916:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787579447.189920:0:9530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319000, rc 0) 00000100:00100000:2.0:1787579447.190028:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+63:11538:x1874412591724032:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 464us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579447.190036:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 181 00000100:00100000:0.0:1787579447.197836:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579447.197912:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591724160 00000100:00100000:3.0:1787579447.197968:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591724160 00000100:00100000:3.0:1787579447.198035:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 53 00000100:00100000:3.0:1787579447.198047:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+7:2360:x1874412591724160:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787579447.198069:0:7660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579447.198094:0:7660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001af0577b/0xb72beeaffa1b797e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d1da expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787579447.198133:0:7660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c4c36, blocks: 0x1 00010000:00010000:3.0:1787579447.198159:0:7660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=383s v=(0 0) 00010000:00010000:3.0:1787579447.198165:0:7660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579447.198177:0:7660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001af0577b/0xb72beeaffa1b797e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1da expref: 8 pid: 7660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.198201:0:7660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001af0577b/0xb72beeaffa1b797e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1da expref: 8 pid: 7660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.198219:0:7660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce90a8a000, rc 0) 00000100:00100000:3.0:1787579447.198299:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+8:2360:x1874412591724160:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 254us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579447.198307:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 53 00000100:00100000:3.0:1787579447.201972:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579447.202056:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591724416 00000100:00100000:0.0:1787579447.202070:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591724416 00000100:00100000:0.0:1787579447.202144:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 182 00000100:00100000:0.0:1787579447.202158:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+63:11538:x1874412591724416:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787579447.202287:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+63:11538:x1874412591724416:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 132us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579447.202295:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 182 00000100:00100000:0.0:1787579447.209212:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579447.209336:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591724544 00000100:00100000:3.0:1787579447.209350:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591724544 00000100:00100000:3.0:1787579447.209427:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 54 00000100:00100000:3.0:1787579447.209440:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+8:11538:x1874412591724544:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787579447.209466:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579447.209496:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f5f1ce3/0xb72beeaffa1b7985 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d1e1 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.209540:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001af0577b/0xb72beeaffa1b797e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1da expref: 9 pid: 7660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.209552:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579447.209558:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579447.209565:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f5f1ce3/0xb72beeaffa1b7985 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1e1 expref: 9 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.209620:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001af0577b/0xb72beeaffa1b797e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1da expref: 9 pid: 7660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.209639:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001af0577b/0xb72beeaffa1b797e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1da expref: 9 pid: 7660 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579447.209657:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebf2f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6710:1874412616882688:192.168.206.53@tcp:104: 00000100:00100000:3.0:1787579447.211164:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cd833f5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787579447.228070:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579447.228146:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebf2f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6710:1874412616882688:192.168.206.53@tcp:104: 00010000:00010000:0.0:1787579447.228188:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009f5f1ce3/0xb72beeaffa1b7985 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1e1 expref: 9 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.228222:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce90a8b400, rc 0) 00000100:00100000:0.0:1787579447.228291:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+9:11538:x1874412591724544:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 18853us (19092us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579447.228301:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 54 00000100:00100000:0.0:1787579447.228352:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591724672 00000100:00100000:0.0:1787579447.228360:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591724672 00010000:00010000:0.0:1787579447.228398:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001af0577b/0xb72beeaffa1b797e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1da expref: 9 pid: 7660 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579447.228431:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 69 00000100:00100000:0.0:1787579447.228440:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce831d7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+9:2359:x1874412591724672:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579447.228457:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579447.228483:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001af0577b/0xb72beeaffa1b797e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1da expref: 9 pid: 7660 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.228497:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001af0577b/0xb72beeaffa1b797e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1da expref: 9 pid: 7660 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.228525:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001af0577b/0xb72beeaffa1b797e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1da expref: 9 pid: 7660 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.228541:0:5851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787579447.228546:0:5851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787579447.228555:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009f5f1ce3/0xb72beeaffa1b7985 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1e1 expref: 8 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.230682:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f5f1ce3/0xb72beeaffa1b7985 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1e1 expref: 8 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.230750:0:5851:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009f5f1ce3/0xb72beeaffa1b7985 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1e1 expref: 8 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579447.230769:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebf834a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5851:1874412616882816:192.168.206.53@tcp:105: 00000100:00100000:0.0:1787579447.230916:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce973ab9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787579447.240983:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebf834a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5851:1874412616882816:192.168.206.53@tcp:105: 00010000:00010000:3.0:1787579447.241039:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579447.241116:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce831d7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+8:2359:x1874412591724672:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 12674us (13058us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579447.241139:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 69 00000100:00100000:3.0:1787579447.246598:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579447.248015:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591724800 00000100:00100000:0.0:1787579447.248033:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591724800 00002000:00100000:0.0:1787579447.248103:0:6717:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffffa0cebf2f3b80 x1874412591724800/t0(0) o4->963d8c17-1326-491b-be60-9002b9296555@192.168.206.53@tcp:688/0 lens 504/0 e 0 to 0 dl 1787579458 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787579447.248115:0:6717:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0cebf2f3b80 with x1874412591724800 ext(0->8) 00002000:00010000:0.0:1787579447.248134:0:6717:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0cebf2f3b80 00000100:00100000:0.0:1787579447.248174:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:0.0:1787579447.248186:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:963d8c17-1326-491b-be60-9002b9296555+8:2362:x1874412591724800:12345-192.168.206.53@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787579447.248737:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:963d8c17-1326-491b-be60-9002b9296555+10:2362:x1874412591724800:12345-192.168.206.53@tcp:4:lhsmtool_posix.0 Request processed in 549us (2160us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787579447.248746:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 5 00002000:00100000:0.0:1787579447.248754:0:6717:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffffa0cebf2f3b80 x1874412591724800/t4294967315(0) o4->963d8c17-1326-491b-be60-9002b9296555@192.168.206.53@tcp:688/0 lens 504/448 e 0 to 0 dl 1787579458 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787579447.248763:0:6717:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0cebf2f3b80 with x1874412591724800 ext(0->8) 00002000:00010000:0.0:1787579447.248766:0:6717:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0cebf2f3b80 00000100:00100000:0.0:1787579447.250980:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579447.251095:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591724928 00000100:00100000:1.0:1787579447.251107:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591724928 00000100:00100000:1.0:1787579447.251457:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 183 00000100:00100000:1.0:1787579447.251481:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+63:11538:x1874412591724928:12345-192.168.206.53@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787579447.371518:0:5888:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:2.0:1787579447.371598:0:5888:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1787579447.371636:0:5888:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0ceba43dc00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1787579447.371641:0:5888:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0ceb1cfc300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0ceba43d840 00000020:00080000:2.0:1787579447.371645:0:5888:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0ceb1cfc000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0cebfa29000 00000001:00080000:2.0:1787579447.371664:0:5888:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:2.0:1787579447.371672:0:5888:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:2.0:1787579447.371701:0:5888:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787579447.372086:0:5899:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1787579447.372290:0:5899:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1787579447.372387:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616882944:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787579447.372471:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579447.372770:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+18:11538:x1874412591724928:12345-192.168.206.53@tcp:44:lhsmtool_posix.0 Request processed in 121287us (121799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579447.372783:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 183 00000100:00100000:1.0:1787579447.372835:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616883072:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787579447.372869:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579447.372913:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616882944 00000100:00100000:1.0:1787579447.372921:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616882944 00000100:00100000:1.0:1787579447.372983:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616883072 00000100:00100000:1.0:1787579447.372987:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616883072 00000100:00100000:1.0:1787579447.373008:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787579447.373018:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3320:x1874412616882944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787579447.373048:0:7660:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1787579447.373087:0:7660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8c4c33, atime: 0x6a8c4c34, ctime: 0x6a8c4c33, blocks: 0x1 00010000:00010000:1.0:1787579447.373097:0:7660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000861fed35/0xb72beeaffa1b798c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.373118:0:7660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787579447.373124:0:7660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579447.373132:0:7660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000861fed35/0xb72beeaffa1b798c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.373151:0:7660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000861fed35/0xb72beeaffa1b798c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.373162:0:7660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000861fed35/0xb72beeaffa1b798c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.373186:0:7660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000861fed35/0xb72beeaffa1b798c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.373205:0:7660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787579447.373749:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3320:x1874412616882944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 729us (1275us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787579447.373759:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787579447.373781:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787579447.373789:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616883072:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787579447.373923:0:7660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787579447.373956:0:7660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787579446 00002000:00010000:1.0:1787579447.373959:0:7660:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787579447.373961:0:7660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787579446 -> 1787579446 00002000:00010000:1.0:1787579447.373964:0:7660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787579447.373995:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3321:x1874412616883072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 207us (1125us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787579447.374001:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00010000:1.0:1787579447.374028:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787579447.374035:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000861fed35/0xb72beeaffa1b798c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.374044:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c9a00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:1.0:1787579447.374048:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000861fed35/0xb72beeaffa1b798c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.374070:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000861fed35/0xb72beeaffa1b798c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.374089:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000861fed35/0xb72beeaffa1b798c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.374097:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000861fed35/0xb72beeaffa1b798c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.374116:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579447.374118:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579447.374120:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787579447.374160:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0cebab6ad80/2, rc 0, transno 4294967307 00000100:00100000:1.0:1787579447.374167:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616882944:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1787579447.374191:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0cebab69c00/2, rc 0, transno 4294967316 00000100:00100000:1.0:1787579447.374195:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616883072:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787579447.391543:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579447.392338:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591725056 00000100:00100000:1.0:1787579447.393006:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591725056 00000100:00100000:1.0:1787579447.393708:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 57 00000100:00100000:1.0:1787579447.394125:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+10:2360:x1874412591725056:12345-192.168.206.53@tcp:16:lhsmtool_posix.0 00000040:00080000:1.0:1787579447.397186:0:12537:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787579447.397197:0:12537:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787579447.397239:0:12537:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787579447.397247:0:12537:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1787579447.476147:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:2.0:1787579447.476169:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000100:00100000:1.0:1787579447.476319:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+7:2360:x1874412591725056:12345-192.168.206.53@tcp:16:lhsmtool_posix.0 Request processed in 82592us (84785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579447.476337:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 57 00000100:00100000:3.0:1787579447.481457:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579447.482166:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591725312 00000100:00100000:0.0:1787579447.482177:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591725312 00000100:00100000:0.0:1787579447.482226:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 184 00000100:00100000:0.0:1787579447.482236:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+18:11538:x1874412591725312:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787579447.482285:0:9530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579447.482311:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b7977 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1d3 expref: 18 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.482327:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0cea147d700) 00010000:00010000:0.0:1787579447.482332:0:9530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787579447.482362:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7993 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.482375:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.482384:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787579447.482701:0:9530:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000828c0b48 reply state 00000000fac342da transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579447.482711:0:9530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787579447.482849:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+19:11538:x1874412591725312:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 613us (1399us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1787579447.482857:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 184 00000100:00100000:0.0:1787579447.489388:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00010000:00010000:1.0:1787579447.489450:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.489461:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7993 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.489468:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7993 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.489473:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579447.489477:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7993 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.489483:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7993 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.489499:0:3306:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0cea147d700) 00010000:00010000:1.0:1787579447.489502:0:3306:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579447.489506:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7993 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.489512:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b7993 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579447.489602:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591725440 00000100:00100000:3.0:1787579447.489611:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591725440 00000100:00100000:3.0:1787579447.490047:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 58 00000100:00100000:3.0:1787579447.490059:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+7:2359:x1874412591725440:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787579447.490294:0:6711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787579447.490298:0:6711:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787579446 -> 1787579445 00002000:00010000:3.0:1787579447.490300:0:6711:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787579444 00002000:00010000:3.0:1787579447.490302:0:6711:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787579446 -> 1787579445 00002000:00010000:3.0:1787579447.490305:0:6711:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787579447.490363:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+8:2359:x1874412591725440:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 Request processed in 306us (982us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1787579447.490371:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 58 00000100:00100000:3.0:1787579447.492231:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579447.492406:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591725696 00000100:00100000:0.0:1787579447.492426:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591725696 00000100:00100000:0.0:1787579447.492477:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 185 00000100:00100000:0.0:1787579447.492487:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+18:11538:x1874412591725696:12345-192.168.206.53@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787579447.492547:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b799a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.492562:0:5866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b795b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1c5 expref: 18 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.492570:0:5866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b799a lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.492601:0:5866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b795b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1c5 expref: 18 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.492616:0:5866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b795b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1c5 expref: 18 pid: 5868 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579447.492629:0:5866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebf834700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5866:1874412616883200:192.168.206.53@tcp:104: 00000100:00100000:0.0:1787579447.492709:0:5866:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb1c51c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787579447.495993:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579447.496006:0:5866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebf834700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5866:1874412616883200:192.168.206.53@tcp:104: 00010000:00010000:0.0:1787579447.496036:0:5866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b799a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579447.496065:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591725824 00000100:00100000:1.0:1787579447.496072:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591725824 00010000:00010000:1.0:1787579447.496107:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b795b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1c5 expref: 19 pid: 5868 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579447.496147:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 70 00000100:00100000:1.0:1787579447.496170:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+19:2360:x1874412591725824:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787579447.496185:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787579447.496193:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b795b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1c5 expref: 19 pid: 5868 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.496205:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b795b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1c5 expref: 19 pid: 5868 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.496226:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b795b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1c5 expref: 19 pid: 5868 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.496241:0:5850:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0cea147d700) 00010000:00010000:1.0:1787579447.496245:0:5850:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b799a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.496255:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b799a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.496263:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b799a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.496290:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787579447.496317:0:5866:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b799a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.496324:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b799a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579447.496335:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+18:2360:x1874412591725824:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 167us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579447.496342:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 70 00010000:00010000:0.0:1787579447.496360:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b799a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.496367:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b799a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.496373:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b799a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.496379:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9a00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579447.496383:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b799a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.496390:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b799a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.496398:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0cea147d700) 00010000:00010000:0.0:1787579447.496402:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787579447.496405:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b799a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579447.496410:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b799a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579447.496448:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+17:11538:x1874412591725696:12345-192.168.206.53@tcp:55:lhsmtool_posix.0 Request processed in 3963us (4224us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787579447.496456:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 185 00000100:00100000:2.0:1787579447.504607:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579447.505244:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591725952 00000100:00100000:3.0:1787579447.505255:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591725952 00000100:00100000:3.0:1787579447.505308:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 59 00000100:00100000:3.0:1787579447.505317:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+8:2361:x1874412591725952:12345-192.168.206.53@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787579447.505360:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000057192080/0xb72beeaffa1b79a1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.505390:0:6712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009f5f1ce3/0xb72beeaffa1b7985 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1e1 expref: 8 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.505399:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579447.505404:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787579447.505408:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057192080/0xb72beeaffa1b79a1 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.505443:0:6712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009f5f1ce3/0xb72beeaffa1b7985 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1e1 expref: 8 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.505458:0:6712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009f5f1ce3/0xb72beeaffa1b7985 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1e1 expref: 8 pid: 6710 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579447.505472:0:6712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba82d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6712:1874412616883328:192.168.206.53@tcp:104: 00000100:00100000:3.0:1787579447.505553:0:6712:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cd833f56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787579447.512292:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579447.512627:0:6712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba82d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6712:1874412616883328:192.168.206.53@tcp:104: 00010000:00010000:3.0:1787579447.512651:0:6712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000057192080/0xb72beeaffa1b79a1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579447.512837:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591726080 00000100:00100000:2.0:1787579447.512844:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591726080 00010000:00010000:2.0:1787579447.512881:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009f5f1ce3/0xb72beeaffa1b7985 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1e1 expref: 9 pid: 6710 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579447.512951:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 71 00000100:00100000:2.0:1787579447.512962:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1768380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:963d8c17-1326-491b-be60-9002b9296555+9:2359:x1874412591726080:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787579447.512976:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579447.513000:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009f5f1ce3/0xb72beeaffa1b7985 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1e1 expref: 9 pid: 6710 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.513012:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009f5f1ce3/0xb72beeaffa1b7985 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1e1 expref: 9 pid: 6710 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.513033:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f5f1ce3/0xb72beeaffa1b7985 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1e1 expref: 9 pid: 6710 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.513046:0:5852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787579447.513051:0:5852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787579447.513056:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000057192080/0xb72beeaffa1b79a1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.513066:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057192080/0xb72beeaffa1b79a1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.513089:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579447.513147:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1768380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:963d8c17-1326-491b-be60-9002b9296555+8:2359:x1874412591726080:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 186us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579447.513156:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 71 00010000:00010000:2.0:1787579447.513186:0:6712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000057192080/0xb72beeaffa1b79a1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.513195:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057192080/0xb72beeaffa1b79a1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.513216:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000057192080/0xb72beeaffa1b79a1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.513223:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057192080/0xb72beeaffa1b79a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.513230:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057192080/0xb72beeaffa1b79a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.513236:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8a200 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579447.513239:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057192080/0xb72beeaffa1b79a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.513247:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057192080/0xb72beeaffa1b79a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.513257:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057192080/0xb72beeaffa1b79a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.513265:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057192080/0xb72beeaffa1b79a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579447.513332:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+7:2361:x1874412591725952:12345-192.168.206.53@tcp:1:lhsmtool_posix.0 Request processed in 8015us (8732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579447.513340:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 59 00000100:00100000:1.0:1787579447.515733:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579447.515818:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591726336 00000100:00100000:2.0:1787579447.515826:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591726336 00000100:00100000:2.0:1787579447.515883:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 186 00000100:00100000:2.0:1787579447.515897:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+17:11538:x1874412591726336:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787579447.516002:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b79a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.516018:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b79a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.516029:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b79a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.516254:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b79af lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.516266:0:5867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7969 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1cc expref: 18 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.516274:0:5867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b79af lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.516306:0:5867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7969 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1cc expref: 18 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579447.516332:0:5867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7969 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1cc expref: 18 pid: 9532 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579447.516346:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab6a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5867:1874412616883456:192.168.206.53@tcp:104: 00000100:00100000:2.0:1787579447.516424:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fbdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787579447.523042:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab6a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5867:1874412616883456:192.168.206.53@tcp:104: 00010000:00010000:3.0:1787579447.523070:0:5867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b79af lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579447.527263:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579447.527297:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591726464 00000100:00100000:1.0:1787579447.527314:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591726464 00010000:00010000:1.0:1787579447.527347:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7969 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1cc expref: 19 pid: 9532 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579447.527379:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 72 00000100:00100000:1.0:1787579447.527388:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec176ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+19:2359:x1874412591726464:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787579447.527401:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787579447.527407:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7969 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1cc expref: 19 pid: 9532 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.527420:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7969 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1cc expref: 19 pid: 9532 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.527439:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7969 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1cc expref: 19 pid: 9532 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.527451:0:5850:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0cea147d700) 00010000:00010000:1.0:1787579447.527456:0:5850:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b79af lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.527464:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b79af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.527471:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b79af lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.527492:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787579447.527538:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec176ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+18:2359:x1874412591726464:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 151us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579447.527553:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 72 00010000:00010000:3.0:1787579447.531183:0:5867:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b79af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.531199:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b79af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787579447.531370:0:5867:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1787579447.531518:0:5867:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1787579447.531562:0:5867:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1787579447.531647:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba82d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5867:1874412616883584:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787579447.531707:0:5867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579447.531749:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cd833f5900 going to sleep for 11 seconds 00000100:00100000:0.0:1787579447.531822:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616883584 00000100:00100000:0.0:1787579447.531830:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616883584 00000100:00100000:0.0:1787579447.531869:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787579447.531901:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5867:x1874412616883584:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787579447.532016:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5867:x1874412616883584:12345-0@lo:1000:mdt00_001.0 Request processed in 117us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579447.532024:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787579447.532185:0:5867:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1787579447.532192:0:5867:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0cebab69c00, transno 4294967316 00000100:00100000:3.0:1787579447.532215:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba82d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5867:1874412616883584:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1787579447.532643:0:5867:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1787579447.532701:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba82d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5867:1874412616883712:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787579447.532750:0:5867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579447.532769:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cd833f56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787579447.532853:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616883712 00000100:00100000:1.0:1787579447.532859:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616883712 00000100:00100000:1.0:1787579447.532896:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787579447.532904:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec16b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5867:x1874412616883712:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787579447.533085:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec16b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5867:x1874412616883712:12345-0@lo:1000:mdt00_001.0 Request processed in 181us (334us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787579447.533092:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787579447.533496:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba82d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5867:1874412616883712:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787579447.533524:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b79af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.533533:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b79af lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.533540:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b79af lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.533558:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba319600 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579447.533562:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b79af lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.533570:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b79af lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.533585:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0cea147d700) 00010000:00010000:3.0:1787579447.533588:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787579447.533593:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b79af lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.533599:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b79af lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.533626:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318200/0xb72beeaffa1b78e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.533633:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318200/0xb72beeaffa1b78e4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.533638:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318200/0xb72beeaffa1b78e4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.533643:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579447.533646:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318200/0xb72beeaffa1b78e4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.533653:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318200/0xb72beeaffa1b78e4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.533671:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0cea147da00) 00010000:00010000:3.0:1787579447.533674:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787579447.533677:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318200/0xb72beeaffa1b78e4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.533683:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318200/0xb72beeaffa1b78e4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.533705:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ac00/0xb72beeaffa1b79b6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.533718:0:5867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7900 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1b0 expref: 21 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.533727:0:5867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ac00/0xb72beeaffa1b79b6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.533752:0:5867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7900 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1b0 expref: 21 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.533765:0:5867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7900 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1b0 expref: 21 pid: 9530 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579447.533777:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec16b7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5867:1874412616883840:192.168.206.53@tcp:104: 00000100:00100000:3.0:1787579447.533853:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cd833f56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787579447.536397:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec16b7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5867:1874412616883840:192.168.206.53@tcp:104: 00010000:00010000:3.0:1787579447.536423:0:5867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ac00/0xb72beeaffa1b79b6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579447.536543:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579447.536748:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591726592 00000100:00100000:3.0:1787579447.536755:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591726592 00010000:00010000:3.0:1787579447.536787:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7900 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1b0 expref: 22 pid: 9530 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579447.536834:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 73 00000100:00100000:3.0:1787579447.536843:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec176b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:963d8c17-1326-491b-be60-9002b9296555+22:2360:x1874412591726592:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787579447.536856:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579447.536863:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7900 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1b0 expref: 22 pid: 9530 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.536874:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7900 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1b0 expref: 22 pid: 9530 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.536895:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7900 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1b0 expref: 22 pid: 9530 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.536910:0:5852:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0cea147da00) 00010000:00010000:3.0:1787579447.536915:0:5852:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ac00/0xb72beeaffa1b79b6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.536952:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ac00/0xb72beeaffa1b79b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.536959:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ac00/0xb72beeaffa1b79b6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.536982:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579447.537036:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec176b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:963d8c17-1326-491b-be60-9002b9296555+21:2360:x1874412591726592:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 193us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579447.537044:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 73 00010000:00010000:1.0:1787579447.537360:0:5867:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ac00/0xb72beeaffa1b79b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.537368:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ac00/0xb72beeaffa1b79b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.537379:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ac00/0xb72beeaffa1b79b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.537385:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ac00/0xb72beeaffa1b79b6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.537391:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ac00/0xb72beeaffa1b79b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.537396:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8ac00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579447.537400:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ac00/0xb72beeaffa1b79b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.537406:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ac00/0xb72beeaffa1b79b6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.537423:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0cea147da00) 00010000:00010000:1.0:1787579447.537425:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579447.537429:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ac00/0xb72beeaffa1b79b6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.537435:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ac00/0xb72beeaffa1b79b6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.537447:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b79a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.537453:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b79a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.537458:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b79a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.537463:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318600 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579447.537466:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b79a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.537472:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b79a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.537479:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0cea147da00) 00010000:00010000:1.0:1787579447.537482:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787579447.537484:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b79a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579447.537489:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b79a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787579447.538101:0:11712:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787579447.538107:0:11712:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787579447.538604:0:11712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1787579447.538613:0:11712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787579447.538721:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+20:11538:x1874412591726336:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 22822us (22991us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1787579447.538732:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 186 00000020:00080000:1.0:1787579447.538737:0:5867:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787579447.544111:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579447.544144:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591726848 00000100:00100000:3.0:1787579447.544153:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591726848 00000100:00100000:3.0:1787579447.544198:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 50 00000100:00100000:3.0:1787579447.544208:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce9c705450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+20:11538:x1874412591726848:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787579447.544972:0:5870:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787579447.545085:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1787579447.545131:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a200/0xb72beeaffa1b79bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.545146:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a200/0xb72beeaffa1b79bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.545157:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a200/0xb72beeaffa1b79bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.545165:0:5870:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a200/0xb72beeaffa1b79bd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.545172:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a200/0xb72beeaffa1b79bd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.545178:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a200/0xb72beeaffa1b79bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.545204:0:5870:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787579447.545282:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce9c705450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+22:11538:x1874412591726848:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 Request processed in 1073us (1176us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1787579447.545290:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 50 00000020:00080000:3.0:1787579447.545295:0:5870:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787579447.545338:0:8475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787579447.545343:0:8475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a200/0xb72beeaffa1b79bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.545350:0:8475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8a200 already unused, calling callback (ffffffffc1654230) 00010000:00010000:3.0:1787579447.545354:0:8475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a200/0xb72beeaffa1b79bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.545363:0:8475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a200/0xb72beeaffa1b79bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.545374:0:8475:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:3.0:1787579447.545377:0:8475:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787579447.545381:0:8475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a200/0xb72beeaffa1b79bd lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.545387:0:8475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a200/0xb72beeaffa1b79bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579447.545402:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579447.545404:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579447.545405:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579447.716087:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787579447.871257:0:6735:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:2.0:1787579447.871275:0:6735:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1787579447.871280:0:6735:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00010000:00010000:0.0:1787579448.737028:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787579449.265902:0:12589:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787579449.265911:0:12589:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787579449.265976:0:12589:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787579449.265982:0:12589:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787579449.382323:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579449.382381:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591727104 00000100:00100000:1.0:1787579449.382390:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591727104 00000100:00100000:1.0:1787579449.382462:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 187 00000100:00100000:1.0:1787579449.382472:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+22:11556:x1874412591727104:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1787579449.382494:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579449.382515:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b79c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d1e8 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579449.382781:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9000/0xb72beeaffa1b79cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579449.382807:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9000/0xb72beeaffa1b79cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579449.382820:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9000/0xb72beeaffa1b79cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787579449.382833:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1787579449.383041:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b79c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1e8 expref: 25 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579449.383056:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9000/0xb72beeaffa1b79cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1e8 expref: 24 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579449.383075:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:1.0:1787579449.383078:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787579449.383081:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb47c9000, rc 0) 00000100:00100000:1.0:1787579449.383132:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+24:11556:x1874412591727104:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 661us (816us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1787579449.383139:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 187 00000100:00080000:0.0:1787579449.383993:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787579449.389082:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579449.391080:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591727232 00000100:00100000:0.0:1787579449.391092:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591727232 00000100:00100000:0.0:1787579449.391147:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 188 00000100:00100000:0.0:1787579449.391156:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec16b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+24:11556:x1874412591727232:12345-192.168.206.53@tcp:34:lfs.0 00010000:00010000:0.0:1787579449.391231:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b79d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391249:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b79d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391260:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b79d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391274:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b79e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391281:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b79e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391287:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b79e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391605:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b79e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391621:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b79e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391628:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b79e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787579449.391665:0:5866:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b79e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391678:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b79d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391684:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b79d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391691:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b79d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391697:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579449.391702:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b79d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391709:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b79d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391721:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:0.0:1787579449.391724:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579449.391729:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b79d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391735:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b79d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391751:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b79e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391757:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b79e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391763:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b79e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391768:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579449.391771:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b79e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391777:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b79e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391797:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0ce82cbb800) 00010000:00010000:0.0:1787579449.391800:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579449.391803:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b79e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391809:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b79e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391823:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b79e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391829:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b79e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391835:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b79e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391845:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579449.391848:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b79e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391855:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b79e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391864:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0ce82cbbc00) 00010000:00010000:0.0:1787579449.391866:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579449.391869:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b79e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.391875:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b79e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579449.391973:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec16b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+24:11556:x1874412591727232:12345-192.168.206.53@tcp:34:lfs.0 Request processed in 816us (2897us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579449.391981:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 188 00000100:00100000:0.0:1787579449.471292:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579449.471379:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591727488 00000100:00100000:1.0:1787579449.471388:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591727488 00000100:00100000:1.0:1787579449.471440:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 189 00000100:00100000:1.0:1787579449.471448:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+24:11559:x1874412591727488:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1787579449.471467:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579449.471486:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b79ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d1ef expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579449.471549:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8a00/0xb72beeaffa1b79f5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579449.471562:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8a00/0xb72beeaffa1b79f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579449.471572:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8a00/0xb72beeaffa1b79f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579449.471586:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b79fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579449.471593:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b79fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579449.471614:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b79fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.472267:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7a03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.472278:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7a03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.472286:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7a03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579449.472296:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787579449.472371:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8a00/0xb72beeaffa1b79f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.472378:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8a00/0xb72beeaffa1b79f5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.472385:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8a00/0xb72beeaffa1b79f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.472391:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c8a00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579449.472395:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8a00/0xb72beeaffa1b79f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.472408:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8a00/0xb72beeaffa1b79f5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.472418:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:2.0:1787579449.472421:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579449.472425:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8a00/0xb72beeaffa1b79f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.472430:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8a00/0xb72beeaffa1b79f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.472440:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b79fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.472447:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b79fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.472453:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b79fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.472458:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c8200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579449.472460:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b79fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.472464:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b79fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.472469:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0ce86456000) 00010000:00010000:2.0:1787579449.472471:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579449.472473:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b79fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.472486:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8200/0xb72beeaffa1b79fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.472523:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b79ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1ef expref: 27 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.472536:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7a03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1ef expref: 26 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.472542:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0cea147d300) 00010000:00010000:2.0:1787579449.472545:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787579449.472547:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba318a00, rc 0) 00000100:00100000:2.0:1787579449.472615:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+26:11559:x1874412591727488:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 1167us (1333us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1787579449.472624:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 189 00000100:00100000:1.0:1787579449.476512:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579449.476626:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591727616 00000100:00100000:3.0:1787579449.476635:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591727616 00000100:00100000:3.0:1787579449.476735:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 190 00000100:00100000:3.0:1787579449.476746:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec176b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+26:11559:x1874412591727616:12345-192.168.206.53@tcp:54:lfs.0 00010000:00010000:3.0:1787579449.476823:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b400/0xb72beeaffa1b7a11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579449.476838:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b400/0xb72beeaffa1b7a11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579449.476849:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b400/0xb72beeaffa1b7a11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579449.476874:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b400/0xb72beeaffa1b7a11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579449.476881:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b400/0xb72beeaffa1b7a11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579449.476888:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b400/0xb72beeaffa1b7a11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579449.476893:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8b400 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579449.476897:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b400/0xb72beeaffa1b7a11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579449.476904:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b400/0xb72beeaffa1b7a11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579449.476988:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0cea147d300) 00010000:00010000:3.0:1787579449.476991:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787579449.476996:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b400/0xb72beeaffa1b7a11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579449.477002:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b400/0xb72beeaffa1b7a11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579449.477072:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec176b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+26:11559:x1874412591727616:12345-192.168.206.53@tcp:54:lfs.0 Request processed in 328us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579449.477080:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 190 00000100:00100000:3.0:1787579449.479010:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579449.479551:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591727872 00000100:00100000:0.0:1787579449.479622:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591727872 00000100:00100000:0.0:1787579449.479819:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 51 00000100:00100000:0.0:1787579449.479829:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec16b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+26:11559:x1874412591727872:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:0.0:1787579449.480231:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec16b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+27:11559:x1874412591727872:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 402us (1226us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1787579449.480239:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 51 00000100:00100000:1.0:1787579449.534403:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579449.534551:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591728128 00000100:00100000:0.0:1787579449.534560:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591728128 00000100:00100000:0.0:1787579449.534636:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 191 00000100:00100000:0.0:1787579449.534645:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+27:11084:x1874412591728128:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:0.0:1787579449.534680:0:9530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579449.534701:0:9530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7a18 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d1f6 expref: -99 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.534807:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7a1f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.534821:0:9530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7a03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1ef expref: 28 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.534830:0:9530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7a1f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.534882:0:9530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7a03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1ef expref: 28 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.534906:0:9530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7a03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1ef expref: 28 pid: 5867 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579449.534920:0:9530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebf836d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9530:1874412616883968:192.168.206.53@tcp:104: 00000100:00100000:0.0:1787579449.535055:0:9530:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb1c51600 going to sleep for 11 seconds 00000100:00100000:1.0:1787579449.543570:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579449.543655:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591728256 00000100:00100000:2.0:1787579449.543674:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591728256 00010000:00010000:2.0:1787579449.543711:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7a03 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1ef expref: 29 pid: 5867 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579449.543749:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 74 00000100:00100000:2.0:1787579449.543760:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+29:2359:x1874412591728256:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787579449.543774:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579449.543780:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7a03 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1ef expref: 29 pid: 5867 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.543816:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7a03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1ef expref: 29 pid: 5867 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.543838:0:5850:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0cea147d300) 00010000:00010000:2.0:1787579449.543843:0:5850:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7a1f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.543852:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7a1f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.543859:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7a1f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.543887:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579449.543971:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+29:2359:x1874412591728256:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 212us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579449.543979:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 74 00010000:00010000:0.0:1787579449.544365:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7a03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1ef expref: 28 pid: 5867 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579449.544382:0:9530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebf836d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9530:1874412616883968:192.168.206.53@tcp:104: 00010000:00010000:0.0:1787579449.544400:0:9530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7a1f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.544416:0:9530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7a1f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.544422:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7a1f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579449.544439:0:9530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787579449.544570:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7a18 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1f6 expref: 29 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.544585:0:9530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7a1f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1f6 expref: 28 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.544592:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0cea147d300) 00010000:00010000:0.0:1787579449.544595:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787579449.544598:0:9530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c8800, rc 0) 00000100:00100000:0.0:1787579449.544684:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+28:11084:x1874412591728128:12345-192.168.206.53@tcp:101:bash.0 Request processed in 10040us (10290us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1787579449.544692:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 191 00000100:00100000:1.0:1787579449.554079:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579449.554169:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591728512 00000100:00100000:0.0:1787579449.554179:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591728512 00000100:00100000:0.0:1787579449.554238:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 192 00000100:00100000:0.0:1787579449.554248:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+28:11084:x1874412591728512:12345-192.168.206.53@tcp:36:bash.0 00010000:00010000:0.0:1787579449.554479:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7a2d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.554495:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7a2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.554517:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7a2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787579449.554584:0:5868:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1787579449.554608:0:5868:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004a6739c6 reply state 000000004e73cff6 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7a2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579449.554617:0:5868:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787579449.554659:0:5868:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1787579449.554763:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+32:11084:x1874412591728512:12345-192.168.206.53@tcp:36:bash.0 Request processed in 516us (692us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1787579449.554771:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 192 00000020:00080000:0.0:1787579449.554776:0:5868:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1787579449.558710:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7a2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.558726:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7a2d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.558734:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7a2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.558739:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579449.558744:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7a2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.558767:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7a2d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.558795:0:3305:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0cea147d300) 00010000:00010000:2.0:1787579449.558798:0:3305:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579449.558803:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7a2d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.558809:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7a2d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579449.559660:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579449.561296:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591728640 00000100:00100000:3.0:1787579449.561308:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591728640 00000100:00100000:3.0:1787579449.561398:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 193 00000100:00100000:3.0:1787579449.561409:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+31:11084:x1874412591728640:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:3.0:1787579449.561430:0:9532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579449.561450:0:9532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b400/0xb72beeaffa1b7a34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d1fd expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579449.561506:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b400/0xb72beeaffa1b7a34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1fd expref: 32 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579449.561520:0:9532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b400/0xb72beeaffa1b7a34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1fd expref: 32 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579449.561538:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0cea147d300) 00010000:00010000:3.0:1787579449.561553:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787579449.561567:0:9532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce90a8b400, rc 0) 00000100:00100000:3.0:1787579449.561683:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+32:11084:x1874412591728640:12345-192.168.206.53@tcp:101:bash.0 Request processed in 275us (2028us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579449.561695:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 193 00000100:00100000:0.0:1787579449.566369:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579449.566464:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591728768 00000100:00100000:2.0:1787579449.566473:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591728768 00000100:00100000:2.0:1787579449.566547:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 60 00000100:00100000:2.0:1787579449.566557:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+7:11084:x1874412591728768:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:2.0:1787579449.566573:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579449.566593:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059f8bded/0xb72beeaffa1b7a3b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d204 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787579449.566618:0:6710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8c4c35, atime: 0x6a8c4c34, ctime: 0x6a8c4c35, blocks: 0xb 00010000:00010000:2.0:1787579449.566642:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=385s v=(0 0) 00010000:00010000:2.0:1787579449.566647:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579449.566655:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059f8bded/0xb72beeaffa1b7a3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d204 expref: 8 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.566681:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000059f8bded/0xb72beeaffa1b7a3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d204 expref: 8 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.566713:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319c00, rc 0) 00000100:00100000:2.0:1787579449.566764:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+8:11084:x1874412591728768:12345-192.168.206.53@tcp:101:bash.0 Request processed in 209us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579449.566772:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 60 00000100:00080000:0.0:1787579449.566988:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787579449.570207:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579449.574218:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591728896 00000100:00100000:0.0:1787579449.574232:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591728896 00002000:00010000:0.0:1787579449.574289:0:6716:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1787579449.574294:0:6716:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0cec14b5880 with x1874412591728896 ext(0->18446744073709551615) 00002000:00010000:0.0:1787579449.574306:0:6716:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0cec14b5880. 00000100:00100000:0.0:1787579449.574344:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:0.0:1787579449.574354:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:963d8c17-1326-491b-be60-9002b9296555+8:2360:x1874412591728896:12345-192.168.206.53@tcp:10:bash.0 00002000:00010000:0.0:1787579449.574599:0:6716:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787579449.574602:0:6716:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787579445 -> 1787579448 00002000:00010000:0.0:1787579449.574605:0:6716:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787579444 -> 1787579444 00002000:00010000:0.0:1787579449.574607:0:6716:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787579445 -> 1787579448 00002000:00010000:0.0:1787579449.574609:0:6716:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787579449.575769:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:963d8c17-1326-491b-be60-9002b9296555+9:2360:x1874412591728896:12345-192.168.206.53@tcp:10:bash.0 Request processed in 1411us (5566us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1787579449.575778:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 6 00002000:00010000:0.0:1787579449.575793:0:6716:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1787579449.575796:0:6716:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0cec14b5880 with x1874412591728896 ext(0->18446744073709551615) 00002000:00010000:0.0:1787579449.575802:0:6716:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0cec14b5880. 00000100:00100000:2.0:1787579449.650302:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579449.651159:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591729024 00000100:00100000:0.0:1787579449.651170:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591729024 00000100:00100000:0.0:1787579449.651237:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 194 00000100:00100000:0.0:1787579449.651247:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+32:11573:x1874412591729024:12345-192.168.206.53@tcp:34:lfs.0 00010000:00010000:0.0:1787579449.651324:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7a42 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.651341:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7a42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.651353:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7a42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.651368:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7a49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.651524:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7a49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.651535:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7a49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.652054:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7a50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.652074:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7a50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.652081:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7a50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787579449.652119:0:9530:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7a50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.652129:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7a42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.652135:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7a42 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.652142:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7a42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.652148:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9600 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579449.652151:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7a42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.652158:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7a42 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.652169:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:0.0:1787579449.652173:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579449.652177:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7a42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.652183:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7a42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.652201:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7a49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.652207:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7a49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.652213:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7a49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.652218:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579449.652221:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7a49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.652227:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7a49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.652235:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0ce82cbbc00) 00010000:00010000:0.0:1787579449.652238:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579449.652241:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7a49 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.652247:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7a49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.654778:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7a50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.654807:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7a50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.654824:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7a50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.654846:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579449.654851:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7a50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.654858:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7a50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.654875:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0cea147d300) 00010000:00010000:0.0:1787579449.654878:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579449.654882:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7a50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.654887:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7a50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579449.655005:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+32:11573:x1874412591729024:12345-192.168.206.53@tcp:34:lfs.0 Request processed in 3753us (4707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579449.655015:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 194 00000100:00100000:3.0:1787579449.708003:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579449.708114:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591729280 00000100:00100000:2.0:1787579449.708124:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591729280 00000100:00100000:2.0:1787579449.708183:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 195 00000100:00100000:2.0:1787579449.708193:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec16b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+32:11576:x1874412591729280:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1787579449.708216:0:5866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579449.708237:0:5866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7a57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d20b expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.708312:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7a5e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.708325:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7a5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.708336:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7a5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.708349:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7a65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.708355:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7a65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.708376:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7a65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.708728:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7a6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.708738:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7a6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.708746:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7a6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579449.708756:0:5866:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787579449.708857:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7a5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.708865:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7a5e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.708871:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7a5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.708877:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579449.708881:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7a5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.708889:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7a5e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.708899:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:2.0:1787579449.708902:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579449.708912:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7a5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.708919:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7a5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.708970:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7a65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.708977:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7a65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.708983:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7a65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.708988:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318a00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579449.708991:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7a65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.708997:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7a65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.709005:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0cea147d500) 00010000:00010000:2.0:1787579449.709007:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579449.709010:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7a65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.709016:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7a65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.709055:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7a57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d20b expref: 35 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.709081:0:5866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7a6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d20b expref: 34 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.709089:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0cea147d300) 00010000:00010000:2.0:1787579449.709091:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787579449.709094:0:5866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319200, rc 0) 00000100:00100000:2.0:1787579449.709162:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec16b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+34:11576:x1874412591729280:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 970us (1168us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1787579449.709170:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 195 00000100:00100000:1.0:1787579449.715778:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579449.716515:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591729408 00000100:00100000:3.0:1787579449.716526:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591729408 00000100:00100000:3.0:1787579449.716591:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 196 00000100:00100000:3.0:1787579449.716602:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+34:11576:x1874412591729408:12345-192.168.206.53@tcp:54:lfs.0 00010000:00010000:3.0:1787579449.716665:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a200/0xb72beeaffa1b7a7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579449.716683:0:9532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7a1f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1f6 expref: 34 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579449.716701:0:9532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a200/0xb72beeaffa1b7a7a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579449.716896:0:9532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7a1f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1f6 expref: 34 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579449.716911:0:9532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7a1f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1f6 expref: 34 pid: 9530 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579449.716944:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec16b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9532:1874412616884096:192.168.206.53@tcp:104: 00000100:00100000:3.0:1787579449.717037:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cd833f53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787579449.722035:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec16b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9532:1874412616884096:192.168.206.53@tcp:104: 00010000:00010000:3.0:1787579449.722076:0:9532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a200/0xb72beeaffa1b7a7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579449.724483:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579449.724571:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591729664 00000100:00100000:2.0:1787579449.724580:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591729664 00000100:00100000:2.0:1787579449.724640:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 52 00000100:00100000:2.0:1787579449.724655:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+35:5601:x1874412591729664:12345-192.168.206.53@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787579449.725007:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+36:5601:x1874412591729664:12345-192.168.206.53@tcp:35:ldlm_bl.0 Request processed in 353us (531us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1787579449.725015:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 52 00000100:00100000:1.0:1787579449.728089:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579449.728171:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591729792 00000100:00100000:3.0:1787579449.728181:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591729792 00010000:00010000:3.0:1787579449.728216:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7a1f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1f6 expref: 36 pid: 9530 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579449.728260:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 75 00000100:00100000:3.0:1787579449.728269:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:963d8c17-1326-491b-be60-9002b9296555+36:2360:x1874412591729792:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787579449.728283:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579449.728291:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7a1f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1f6 expref: 36 pid: 9530 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579449.728305:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7a1f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1f6 expref: 36 pid: 9530 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579449.728326:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7a1f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1f6 expref: 36 pid: 9530 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579449.728341:0:5852:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0cea147d300) 00010000:00010000:3.0:1787579449.728346:0:5852:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a200/0xb72beeaffa1b7a7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579449.728354:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a200/0xb72beeaffa1b7a7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579449.728362:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a200/0xb72beeaffa1b7a7a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579449.728408:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579449.728460:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:963d8c17-1326-491b-be60-9002b9296555+35:2360:x1874412591729792:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 191us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579449.728467:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 75 00010000:00010000:2.0:1787579449.728530:0:9532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a200/0xb72beeaffa1b7a7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.728538:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a200/0xb72beeaffa1b7a7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.728577:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a200/0xb72beeaffa1b7a7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.728584:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a200/0xb72beeaffa1b7a7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.728598:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a200/0xb72beeaffa1b7a7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.728604:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8a200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579449.728608:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a200/0xb72beeaffa1b7a7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.728616:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a200/0xb72beeaffa1b7a7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.728626:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0cea147d300) 00010000:00010000:2.0:1787579449.728628:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787579449.728632:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a200/0xb72beeaffa1b7a7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.728638:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a200/0xb72beeaffa1b7a7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579449.728677:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+34:11576:x1874412591729408:12345-192.168.206.53@tcp:54:lfs.0 Request processed in 12077us (12907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579449.728685:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 196 00000100:00100000:3.0:1787579449.733318:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579449.733397:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591730048 00000100:00100000:2.0:1787579449.733419:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591730048 00000100:00100000:2.0:1787579449.733474:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 53 00000100:00100000:2.0:1787579449.733485:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec16b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+34:11576:x1874412591730048:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:2.0:1787579449.733882:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec16b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+35:11576:x1874412591730048:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 398us (571us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1787579449.733891:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 53 00010000:00010000:1.0:1787579449.760734:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579449.849209:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579449.849305:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591730304 00000100:00100000:0.0:1787579449.849314:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591730304 00000100:00100000:0.0:1787579449.849371:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 197 00000100:00100000:0.0:1787579449.849381:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+35:11587:x1874412591730304:12345-192.168.206.53@tcp:101:cat.0 00010000:00010000:0.0:1787579449.849417:0:9530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579449.849438:0:9530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7a81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d212 expref: -99 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.849511:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7a88 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.849538:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7a88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.849565:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7a88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.849582:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7a8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.849588:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7a8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.849595:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7a8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.849914:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7a96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.849971:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.849981:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579449.849990:0:9530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1787579449.850078:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7a88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.850085:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7a88 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.850090:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7a88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.850102:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9600 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579449.850107:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7a88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.850114:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7a88 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.850125:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:0.0:1787579449.850128:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579449.850133:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7a88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.850138:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7a88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.850149:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7a8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.850155:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7a8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.850160:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7a8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.850164:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579449.850167:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7a8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.850173:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7a8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.850189:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0ce82cbbc00) 00010000:00010000:0.0:1787579449.850192:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579449.850195:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7a8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.850201:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b7a8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.850240:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7a81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d212 expref: 38 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.850252:0:9530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7a96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d212 expref: 37 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.850259:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0cea147d300) 00010000:00010000:0.0:1787579449.850261:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787579449.850264:0:9530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c9200, rc 0) 00000100:00100000:0.0:1787579449.850326:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+37:11587:x1874412591730304:12345-192.168.206.53@tcp:101:cat.0 Request processed in 946us (1127us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1787579449.850334:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 197 00000100:00100000:1.0:1787579449.864071:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579449.864163:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591730560 00000100:00100000:0.0:1787579449.864181:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591730560 00000100:00100000:0.0:1787579449.864236:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 54 00000100:00100000:0.0:1787579449.864246:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+37:11587:x1874412591730560:12345-192.168.206.53@tcp:35:cat.0 00000100:00100000:0.0:1787579449.864464:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+38:11587:x1874412591730560:12345-192.168.206.53@tcp:35:cat.0 Request processed in 219us (401us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1787579449.864473:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 54 00000100:00100000:3.0:1787579449.894511:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579449.894621:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591730816 00000100:00100000:2.0:1787579449.894630:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591730816 00000100:00100000:2.0:1787579449.894689:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 198 00000100:00100000:2.0:1787579449.894700:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec16b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+38:11588:x1874412591730816:12345-192.168.206.53@tcp:36:rm.0 00010000:00010000:2.0:1787579449.894754:0:5867:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787579449.894793:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7a96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d212 expref: 38 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.894818:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7a6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d20b expref: 37 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.894831:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b400/0xb72beeaffa1b7a34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1fd expref: 36 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.894851:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0cea147d300) 00010000:00010000:2.0:1787579449.894862:0:5867:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787579449.894882:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7aa4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.894895:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7aa4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.894904:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7aa4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.894917:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7aab lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.894923:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7aab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.895004:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7aab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.895282:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7ab2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.895291:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7ab2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.895298:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7ab2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787579449.895874:0:5867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1787579449.895884:0:5867:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 386086957128ns, next at 387086954871ns, rc = 0 00010000:00010000:2.0:1787579449.895966:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7ab9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.895976:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7ab9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.895984:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7ab9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.895991:0:5867:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7ab9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.895998:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7ab9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.896005:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7ab9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.896029:0:5867:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787579449.896048:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7ab2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.896055:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7ab2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.896061:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7ab2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.896066:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579449.896070:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7ab2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.896078:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7ab2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.896088:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0cea147da00) 00010000:00010000:2.0:1787579449.896091:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787579449.896095:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7ab2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.896101:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7ab2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.896115:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7aa4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.896120:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7aa4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.896126:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7aa4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.896137:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba319a00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579449.896140:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7aa4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.896146:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7aa4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.896155:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:2.0:1787579449.896157:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579449.896160:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7aa4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.896166:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7aa4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787579449.896176:0:5867:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002de87a4a reply state 00000000154c1916 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7aab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579449.896184:0:5867:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787579449.896255:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec16b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+37:11588:x1874412591730816:12345-192.168.206.53@tcp:36:rm.0 Request processed in 1554us (1752us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1787579449.896263:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 198 00010000:00010000:0.0:1787579449.896583:0:8475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787579449.896590:0:8475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7ab9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.896597:0:8475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318000 already unused, calling callback (ffffffffc1654230) 00010000:00010000:0.0:1787579449.896601:0:8475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7ab9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.896608:0:8475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7ab9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.896618:0:8475:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0cea147da00) 00010000:00010000:0.0:1787579449.896620:0:8475:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787579449.896624:0:8475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7ab9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.896629:0:8475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7ab9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.896643:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579449.896645:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579449.896647:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579449.901486:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7aab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.901503:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7aab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.901511:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7aab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.901535:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318a00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579449.901540:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7aab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.901547:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7aab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.901575:0:3306:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0cea147d500) 00010000:00010000:2.0:1787579449.901578:0:3306:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579449.901583:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7aab lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.901589:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7aab lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579449.956136:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579449.957473:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591731072 00000100:00100000:2.0:1787579449.957492:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591731072 00000100:00100000:2.0:1787579449.957614:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 199 00000100:00100000:2.0:1787579449.957626:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec16b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+36:11594:x1874412591731072:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:2.0:1787579449.957655:0:9532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579449.957677:0:9532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7ac0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d219 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.957824:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7ac7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.957849:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7ac7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.957885:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7ac7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.957911:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7ace lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.957919:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7ace lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.957949:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7ace lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787579449.958832:0:9532:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1787579449.959363:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7ad5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.959376:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.959386:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.959421:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7ac7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.959429:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7ac7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.959436:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7ac7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.959442:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba319a00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579449.959454:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7ac7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.959462:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7ac7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.959475:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:2.0:1787579449.959479:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579449.959483:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7ac7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.959489:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7ac7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787579449.959500:0:9532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f93bf53 reply state 000000002ff70784 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7ace lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579449.959509:0:9532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787579449.959542:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318a00/0xb72beeaffa1b7ac0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d219 expref: 39 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.959701:0:9532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d219 expref: 38 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.959710:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0cea147d300) 00010000:00010000:2.0:1787579449.959766:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787579449.959770:0:9532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319200, rc 0) 00000100:00100000:2.0:1787579449.960307:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec16b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+39:11594:x1874412591731072:12345-192.168.206.53@tcp:101:bash.0 Request processed in 2681us (4177us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787579449.960317:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 199 00010000:00010000:0.0:1787579449.964399:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7ace lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.964416:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7ace lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.964485:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7ace lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.964492:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579449.964497:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7ace lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.964518:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7ace lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.964601:0:3305:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0cea147d500) 00010000:00010000:0.0:1787579449.964605:0:3305:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579449.964610:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7ace lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.964617:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7ace lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579449.970145:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579449.970491:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591731200 00000100:00100000:0.0:1787579449.970501:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591731200 00000100:00100000:0.0:1787579449.970643:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 61 00000100:00100000:0.0:1787579449.970655:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec16b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+5:2359:x1874412591731200:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:0.0:1787579449.970673:0:7660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579449.970822:0:7660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003de0f713/0xb72beeaffa1b7ae3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d220 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787579449.970826:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1787579449.970851:0:7660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787579449.970870:0:7660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=386s v=(0 0) 00010000:00010000:0.0:1787579449.970875:0:7660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787579449.970885:0:7660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003de0f713/0xb72beeaffa1b7ae3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d220 expref: 6 pid: 7660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.970903:0:7660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003de0f713/0xb72beeaffa1b7ae3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d220 expref: 6 pid: 7660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579449.971389:0:7660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c8e00, rc 0) 00000100:00100000:1.0:1787579449.972149:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec16b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+6:2359:x1874412591731200:12345-192.168.206.53@tcp:101:bash.0 Request processed in 1492us (2008us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579449.972159:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 61 00000100:00100000:1.0:1787579449.980413:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579449.980495:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591731328 00000100:00100000:2.0:1787579449.980505:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591731328 00000100:00100000:2.0:1787579449.980565:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 62 00000100:00100000:2.0:1787579449.980576:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+6:11594:x1874412591731328:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:2.0:1787579449.980591:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579449.980609:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003adfca9b/0xb72beeaffa1b7aea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d227 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.980638:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003de0f713/0xb72beeaffa1b7ae3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d220 expref: 7 pid: 7660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.980648:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579449.980651:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579449.980656:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003adfca9b/0xb72beeaffa1b7aea lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d227 expref: 7 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.980686:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003de0f713/0xb72beeaffa1b7ae3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d220 expref: 7 pid: 7660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.980699:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003de0f713/0xb72beeaffa1b7ae3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d220 expref: 7 pid: 7660 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579449.980712:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab69880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6710:1874412616884224:192.168.206.53@tcp:104: 00000100:00100000:2.0:1787579449.980821:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fbda80 going to sleep for 11 seconds 00000100:00100000:3.0:1787579449.984199:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579449.984663:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591731456 00000100:00100000:1.0:1787579449.984673:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591731456 00010000:00010000:1.0:1787579449.984712:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003de0f713/0xb72beeaffa1b7ae3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d220 expref: 8 pid: 7660 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579449.984761:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 76 00000100:00100000:1.0:1787579449.984771:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce831d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+8:2360:x1874412591731456:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787579449.984812:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787579449.985080:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003de0f713/0xb72beeaffa1b7ae3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d220 expref: 8 pid: 7660 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579449.985097:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003de0f713/0xb72beeaffa1b7ae3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d220 expref: 8 pid: 7660 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579449.985119:0:5850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579449.985123:0:5850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579449.985132:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003adfca9b/0xb72beeaffa1b7aea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d227 expref: 8 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579449.985141:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003adfca9b/0xb72beeaffa1b7aea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d227 expref: 8 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579449.985175:0:5850:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003adfca9b/0xb72beeaffa1b7aea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d227 expref: 8 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579449.985188:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec14b7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5850:1874412616884352:192.168.206.53@tcp:105: 00000100:00100000:1.0:1787579449.985262:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce92d47480 going to sleep for 11 seconds 00010000:00010000:2.0:1787579449.985414:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003de0f713/0xb72beeaffa1b7ae3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d220 expref: 8 pid: 7660 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579449.985440:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab69880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6710:1874412616884224:192.168.206.53@tcp:104: 00010000:00010000:2.0:1787579449.985460:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003adfca9b/0xb72beeaffa1b7aea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d227 expref: 7 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579449.985471:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319a00, rc 0) 00000100:00100000:2.0:1787579449.985507:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+7:11594:x1874412591731328:12345-192.168.206.53@tcp:101:bash.0 Request processed in 4933us (5104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579449.985515:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 62 00000100:00100000:1.0:1787579450.000675:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec14b7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5850:1874412616884352:192.168.206.53@tcp:105: 00010000:00010000:1.0:1787579450.000767:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787579450.000840:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce831d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+6:2360:x1874412591731456:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 16069us (16649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579450.000850:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 76 00000100:00100000:1.0:1787579450.003072:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579450.005469:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591731712 00000100:00100000:0.0:1787579450.005482:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591731712 00000100:00100000:0.0:1787579450.005607:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 55 00000100:00100000:0.0:1787579450.005618:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+38:11594:x1874412591731712:12345-192.168.206.53@tcp:35:bash.0 00000100:00100000:0.0:1787579450.007115:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+39:11594:x1874412591731712:12345-192.168.206.53@tcp:35:bash.0 Request processed in 1492us (4044us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1787579450.007125:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 55 00000100:00100000:0.0:1787579450.223006:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579450.223090:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591731840 00000100:00100000:2.0:1787579450.223099:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591731840 00000100:00100000:2.0:1787579450.223153:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 200 00000100:00100000:2.0:1787579450.223164:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+39:11610:x1874412591731840:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1787579450.223186:0:5866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579450.223206:0:5866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7af1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d22e expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.223265:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b7af8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.223277:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b7af8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.223287:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b7af8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579450.223341:0:5866:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787579450.223356:0:5866:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787579450.223381:0:5866:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b7af8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.223404:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b7af1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d22e expref: 41 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.223421:0:5866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b7af8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d22e expref: 40 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.223429:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:2.0:1787579450.223432:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787579450.223435:0:5866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba318600, rc 0) 00000100:00100000:2.0:1787579450.223495:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+40:11610:x1874412591731840:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 332us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579450.223502:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 200 00000100:00100000:3.0:1787579450.228547:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579450.228649:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591732096 00000100:00100000:1.0:1787579450.228659:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591732096 00000100:00100000:1.0:1787579450.228715:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 201 00000100:00100000:1.0:1787579450.228726:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec16b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+40:11610:x1874412591732096:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1787579450.228745:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579450.228764:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b7aff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d235 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.228866:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9800/0xb72beeaffa1b7b06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.228890:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9800/0xb72beeaffa1b7b06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.228901:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9800/0xb72beeaffa1b7b06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787579450.228913:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787579450.229070:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9a00/0xb72beeaffa1b7aff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d235 expref: 43 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.229089:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9800/0xb72beeaffa1b7b06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d235 expref: 42 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.229097:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0cea147d300) 00010000:00010000:1.0:1787579450.229100:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787579450.229104:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb47c9800, rc 0) 00000100:00100000:1.0:1787579450.229164:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec16b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+42:11610:x1874412591732096:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 439us (626us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1787579450.229184:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 201 00000100:00100000:1.0:1787579450.233475:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579450.233512:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579450.233589:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591732352 00000100:00100000:2.0:1787579450.233597:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591732352 00000100:00100000:2.0:1787579450.233647:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 202 00000100:00100000:2.0:1787579450.233656:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+42:11610:x1874412591732352:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1787579450.233676:0:9532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579450.233707:0:9532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7b14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d23c expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.233837:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7b1b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.233851:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7b1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.233887:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7b1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579450.233899:0:9532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787579450.234030:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7b14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d23c expref: 45 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.234047:0:9532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7b1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d23c expref: 44 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.234056:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0cea147d300) 00010000:00010000:2.0:1787579450.234059:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787579450.234062:0:9532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319e00, rc 0) 00000100:00100000:2.0:1787579450.234111:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+44:11610:x1874412591732352:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 456us (647us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1787579450.234118:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 202 00000100:00100000:0.0:1787579450.234691:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591732480 00000100:00100000:0.0:1787579450.234697:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591732480 00000100:00100000:0.0:1787579450.234746:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 14 00000100:00100000:0.0:1787579450.234753:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+44:2360:x1874412591732480:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579450.234762:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579450.234775:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9800/0xb72beeaffa1b7b06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d235 expref: 44 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.234797:0:5851:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0cea147d300) 00010000:00010000:0.0:1787579450.234801:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579450.234833:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+43:2360:x1874412591732480:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 79us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579450.234839:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 14 00000100:00100000:1.0:1787579450.244807:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579450.244906:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591732608 00000100:00100000:2.0:1787579450.244915:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591732608 00000100:00100000:2.0:1787579450.245003:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 63 00000100:00100000:2.0:1787579450.245013:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+6:2359:x1874412591732608:12345-192.168.206.53@tcp:1:lfs.0 00010000:00010000:2.0:1787579450.245056:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b860913/0xb72beeaffa1b7b29 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.245076:0:6712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003adfca9b/0xb72beeaffa1b7aea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d227 expref: 6 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.245086:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579450.245102:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787579450.245108:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b860913/0xb72beeaffa1b7b29 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.245142:0:6712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003adfca9b/0xb72beeaffa1b7aea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d227 expref: 6 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.245155:0:6712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003adfca9b/0xb72beeaffa1b7aea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d227 expref: 6 pid: 6710 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579450.245170:0:6712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab69880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6712:1874412616884480:192.168.206.53@tcp:104: 00000100:00100000:2.0:1787579450.245261:0:6712:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fbdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787579450.249272:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579450.249364:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591732736 00000100:00100000:0.0:1787579450.249374:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591732736 00002000:00100000:0.0:1787579450.249439:0:6717:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffffa0cebab68380 x1874412591732736/t0(0) o4->963d8c17-1326-491b-be60-9002b9296555@192.168.206.53@tcp:691/0 lens 504/0 e 0 to 0 dl 1787579461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787579450.249449:0:6717:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0cebab68380 with x1874412591732736 ext(0->8) 00010000:00010000:0.0:1787579450.249458:0:6717:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003adfca9b/0xb72beeaffa1b7aea lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d227 expref: 7 pid: 6710 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.249475:0:6717:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003adfca9b/0xb72beeaffa1b7aea lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d227 expref: 7 pid: 6710 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787579450.249483:0:6717:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa0cebab68380 00000100:00100000:0.0:1787579450.249520:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 3 00000100:00100000:0.0:1787579450.249530:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:963d8c17-1326-491b-be60-9002b9296555+7:2359:x1874412591732736:12345-192.168.206.53@tcp:4:lfs.0 00000100:00100000:0.0:1787579450.250090:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:963d8c17-1326-491b-be60-9002b9296555+9:2359:x1874412591732736:12345-192.168.206.53@tcp:4:lfs.0 Request processed in 557us (822us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787579450.250098:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 3 00002000:00100000:0.0:1787579450.250105:0:6717:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffffa0cebab68380 x1874412591732736/t4294967308(0) o4->963d8c17-1326-491b-be60-9002b9296555@192.168.206.53@tcp:691/0 lens 504/448 e 0 to 0 dl 1787579461 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787579450.250112:0:6717:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0cebab68380 with x1874412591732736 ext(0->8) 00010000:00010000:0.0:1787579450.250119:0:6717:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003adfca9b/0xb72beeaffa1b7aea lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d227 expref: 9 pid: 6710 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.250131:0:6717:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003adfca9b/0xb72beeaffa1b7aea lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d227 expref: 9 pid: 6710 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787579450.250138:0:6717:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa0cebab68380 00000100:00100000:3.0:1787579450.250481:0:6712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab69880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6712:1874412616884480:192.168.206.53@tcp:104: 00010000:00010000:3.0:1787579450.250503:0:6712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006b860913/0xb72beeaffa1b7b29 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579450.253164:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579450.253264:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591732864 00000100:00100000:0.0:1787579450.253275:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591732864 00010000:00010000:0.0:1787579450.253311:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003adfca9b/0xb72beeaffa1b7aea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d227 expref: 9 pid: 6710 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579450.253402:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 77 00000100:00100000:0.0:1787579450.253412:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec16b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+9:2362:x1874412591732864:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579450.253426:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787579450.253443:0:8477:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787579450.253446:0:8477:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787579449 00002000:00010000:0.0:1787579450.253448:0:8477:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787579449 00002000:00010000:0.0:1787579450.253451:0:8477:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787579449 00010000:00010000:0.0:1787579450.253457:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003adfca9b/0xb72beeaffa1b7aea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d227 expref: 9 pid: 6710 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.253471:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003adfca9b/0xb72beeaffa1b7aea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d227 expref: 9 pid: 6710 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.253493:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003adfca9b/0xb72beeaffa1b7aea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d227 expref: 9 pid: 6710 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.253509:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787579450.253514:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787579450.253520:0:8477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006b860913/0xb72beeaffa1b7b29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.253529:0:8477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b860913/0xb72beeaffa1b7b29 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.253581:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579450.253677:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec16b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+8:2362:x1874412591732864:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 266us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579450.253685:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 77 00010000:00010000:3.0:1787579450.253750:0:6712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006b860913/0xb72beeaffa1b7b29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.253760:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b860913/0xb72beeaffa1b7b29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.253796:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b860913/0xb72beeaffa1b7b29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.253804:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b860913/0xb72beeaffa1b7b29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.253817:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b860913/0xb72beeaffa1b7b29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.253824:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318400 already unused, calling callback (ffffffffc1654230) 00010000:00010000:3.0:1787579450.253828:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b860913/0xb72beeaffa1b7b29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.253837:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b860913/0xb72beeaffa1b7b29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.253848:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b860913/0xb72beeaffa1b7b29 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.253855:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b860913/0xb72beeaffa1b7b29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579450.253898:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+7:2359:x1874412591732608:12345-192.168.206.53@tcp:1:lfs.0 Request processed in 8886us (9100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579450.253905:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 63 00000100:00100000:1.0:1787579450.259383:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579450.259457:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591733120 00000100:00100000:0.0:1787579450.259466:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591733120 00000100:00100000:0.0:1787579450.259522:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 56 00000100:00100000:0.0:1787579450.259533:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce9c707c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+43:11610:x1874412591733120:12345-192.168.206.53@tcp:35:lfs.0 00000004:00010000:0.0:1787579450.259604:0:5869:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7b1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d23c expref: 43 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787579450.259867:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1787579450.259965:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1787579450.260262:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1787579450.260316:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b7b30 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.260331:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7ad5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d219 expref: 47 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.260339:0:5869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b7b30 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.260370:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d219 expref: 47 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.260384:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7ad5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d219 expref: 47 pid: 9532 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579450.260411:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebf836300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5869:1874412616884608:192.168.206.53@tcp:104: 00000100:00100000:0.0:1787579450.260482:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb1c51b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787579450.264088:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579450.264277:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591733248 00000100:00100000:3.0:1787579450.264287:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591733248 00010000:00010000:3.0:1787579450.264324:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7ad5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d219 expref: 48 pid: 9532 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579450.264354:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 78 00000100:00100000:3.0:1787579450.264376:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf835500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+48:2360:x1874412591733248:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787579450.264391:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579450.264398:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7ad5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d219 expref: 48 pid: 9532 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.264411:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7ad5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d219 expref: 48 pid: 9532 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.264431:0:5851:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0cea147d300) 00010000:00010000:3.0:1787579450.264437:0:5851:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b7b30 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.264446:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b7b30 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.264453:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b7b30 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.264472:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579450.264528:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf835500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+48:2360:x1874412591733248:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 153us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579450.264536:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 78 00010000:00010000:1.0:1787579450.264670:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7ad5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d219 expref: 47 pid: 9532 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579450.264686:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebf836300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5869:1874412616884608:192.168.206.53@tcp:104: 00010000:00010000:1.0:1787579450.264705:0:5869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b7b30 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.264725:0:5869:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b7b30 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.264731:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b7b30 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787579450.264851:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1787579450.265091:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1787579450.265209:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec14b4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5869:1874412616884736:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787579450.265259:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579450.265295:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce92d47f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787579450.265422:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616884736 00000100:00100000:2.0:1787579450.265428:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616884736 00000100:00100000:2.0:1787579450.265480:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787579450.265490:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5869:x1874412616884736:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787579450.265554:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5869:x1874412616884736:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 66us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579450.265560:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1787579450.265679:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787579450.265703:0:5869:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1787579450.265707:0:5869:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1787579450.265734:0:5869:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0cebab6ad80, transno 4294967307 00000100:00100000:1.0:1787579450.265854:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec14b4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5869:1874412616884736:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787579450.266395:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1787579450.266454:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec14b4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5869:1874412616884864:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787579450.266493:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579450.266518:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce92d47cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787579450.266591:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616884864 00000100:00100000:3.0:1787579450.266597:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616884864 00000100:00100000:3.0:1787579450.266635:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787579450.266644:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5869:x1874412616884864:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787579450.266798:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5869:x1874412616884864:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 139us (288us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787579450.266816:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787579450.267366:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec14b4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5869:1874412616884864:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787579450.267415:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1787579450.267451:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b7b30 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.267461:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b7b30 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.267468:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b7b30 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.267474:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9c00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579450.267478:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b7b30 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.267485:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b7b30 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.267501:0:5869:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0cea147d300) 00010000:00010000:1.0:1787579450.267504:0:5869:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787579450.267508:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b7b30 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.267514:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9c00/0xb72beeaffa1b7b30 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787579450.267691:0:5869:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787579450.267832:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1787579450.267843:0:5869:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 386458915593ns, next at 387458913813ns, rc = 0 00000001:00080000:1.0:1787579450.267849:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1787579450.267879:0:5869:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0cea147d300) 00010000:00010000:1.0:1787579450.267883:0:5869:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787579450.267889:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7b1b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d23c expref: 51 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579450.269964:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce9c707c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+50:11610:x1874412591733120:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 10423us (10580us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1787579450.269976:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 56 00000020:00080000:1.0:1787579450.269981:0:5869:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787579450.275235:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579450.275318:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591733376 00000100:00100000:3.0:1787579450.275328:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591733376 00000100:00100000:3.0:1787579450.275411:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 203 00000100:00100000:3.0:1787579450.275421:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+50:11610:x1874412591733376:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1787579450.275445:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579450.275468:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a000/0xb72beeaffa1b7b37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d243 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.275529:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a000/0xb72beeaffa1b7b37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d243 expref: 51 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.275542:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a000/0xb72beeaffa1b7b37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d243 expref: 51 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.275572:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:3.0:1787579450.275576:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787579450.275580:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce90a8a000, rc 0) 00000100:00100000:3.0:1787579450.275642:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+51:11610:x1874412591733376:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 222us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579450.275650:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 203 00000100:00100000:1.0:1787579450.281621:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579450.281745:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591733632 00000100:00100000:3.0:1787579450.281754:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591733632 00000100:00100000:3.0:1787579450.281812:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 57 00000100:00100000:3.0:1787579450.281822:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+51:11610:x1874412591733632:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:3.0:1787579450.282404:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+52:11610:x1874412591733632:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 581us (790us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1787579450.282429:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 57 00000100:00100000:0.0:1787579450.375172:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579450.375260:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591733760 00000100:00100000:1.0:1787579450.375270:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591733760 00000100:00100000:1.0:1787579450.375325:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 204 00000100:00100000:1.0:1787579450.375336:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+52:11620:x1874412591733760:12345-192.168.206.53@tcp:34:lfs.0 00010000:00010000:1.0:1787579450.375407:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b7b3e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.375423:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b7b3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.375432:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b7b3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.375446:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b7b45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.375452:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b7b45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.375473:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b7b45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.375568:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8800/0xb72beeaffa1b7b4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.375576:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8800/0xb72beeaffa1b7b4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.375583:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8800/0xb72beeaffa1b7b4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787579450.375624:0:9530:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8800/0xb72beeaffa1b7b4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.375636:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b7b3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.375642:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b7b3e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.375650:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b7b3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.375655:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c8000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579450.375660:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b7b3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.375667:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b7b3e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.375679:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:1.0:1787579450.375689:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579450.375693:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b7b3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.375700:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8000/0xb72beeaffa1b7b3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.375714:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b7b45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.375720:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b7b45 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.375726:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b7b45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.375731:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c8c00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579450.375734:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b7b45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.375739:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b7b45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.375747:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0ce86456a00) 00010000:00010000:1.0:1787579450.375750:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579450.375753:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b7b45 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.375758:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8c00/0xb72beeaffa1b7b45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.375772:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8800/0xb72beeaffa1b7b4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.375797:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8800/0xb72beeaffa1b7b4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.375803:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8800/0xb72beeaffa1b7b4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.375808:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c8800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579450.375812:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8800/0xb72beeaffa1b7b4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.375818:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8800/0xb72beeaffa1b7b4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.375826:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:1.0:1787579450.375829:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579450.375996:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8800/0xb72beeaffa1b7b4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579450.376004:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8800/0xb72beeaffa1b7b4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579450.376076:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+52:11620:x1874412591733760:12345-192.168.206.53@tcp:34:lfs.0 Request processed in 741us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579450.376084:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 204 00000100:00100000:0.0:1787579450.453739:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579450.453853:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591734016 00000100:00100000:3.0:1787579450.453863:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591734016 00000100:00100000:3.0:1787579450.453922:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 205 00000100:00100000:3.0:1787579450.453959:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+52:11623:x1874412591734016:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1787579450.453978:0:5866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579450.453997:0:5866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b800/0xb72beeaffa1b7b53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d24a expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.454062:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7b5a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.454074:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7b5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.454083:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7b5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.454097:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7b61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.454103:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7b61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.454109:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7b61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.454237:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7b68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.454265:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7b68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.454272:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7b68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579450.454283:0:5866:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787579450.454373:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7b5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.454381:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7b5a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.454386:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7b5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.454391:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8bc00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579450.454395:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7b5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.454401:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7b5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.454412:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:3.0:1787579450.454415:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579450.454418:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7b5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.454424:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7b5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.454436:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7b61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.454449:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7b61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.454454:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7b61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.454459:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8a800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579450.454462:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7b61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.454469:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7b61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.454478:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0ce84d55b00) 00010000:00010000:3.0:1787579450.454480:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579450.454482:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7b61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.454488:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7b61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.454885:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b800/0xb72beeaffa1b7b53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d24a expref: 55 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.454903:0:5866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7b68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d24a expref: 54 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.454911:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:3.0:1787579450.454914:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787579450.454963:0:5866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce90a8b000, rc 0) 00000100:00100000:3.0:1787579450.455074:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+54:11623:x1874412591734016:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 1117us (1343us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1787579450.455083:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 205 00000100:00100000:3.0:1787579450.461399:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579450.461463:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591734144 00000100:00100000:2.0:1787579450.461474:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591734144 00000100:00100000:2.0:1787579450.461535:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 206 00000100:00100000:2.0:1787579450.461546:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec16b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+54:11623:x1874412591734144:12345-192.168.206.53@tcp:54:lfs.0 00010000:00010000:2.0:1787579450.461608:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b7b76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.461638:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b7b76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.461649:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b7b76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.461674:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b7b76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.461680:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b7b76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.461685:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b7b76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.461691:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba319000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579450.461694:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b7b76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.461701:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b7b76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.461711:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:2.0:1787579450.461714:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787579450.461718:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b7b76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.461725:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b7b76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579450.461803:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec16b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+54:11623:x1874412591734144:12345-192.168.206.53@tcp:54:lfs.0 Request processed in 258us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579450.461816:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 206 00000100:00100000:1.0:1787579450.466805:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579450.466919:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591734400 00000100:00100000:2.0:1787579450.466948:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591734400 00000100:00100000:2.0:1787579450.467002:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 58 00000100:00100000:2.0:1787579450.467012:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+54:11623:x1874412591734400:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:2.0:1787579450.467231:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+55:11623:x1874412591734400:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 220us (435us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1787579450.467239:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 58 00000100:00100000:0.0:1787579450.584800:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579450.584903:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591734656 00000100:00100000:2.0:1787579450.584914:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591734656 00000100:00100000:2.0:1787579450.584994:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 207 00000100:00100000:2.0:1787579450.585005:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+55:11633:x1874412591734656:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:2.0:1787579450.585029:0:9532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579450.585032:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787579450.585058:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b7af8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d22e expref: 55 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.585078:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:2.0:1787579450.585082:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787579450.585094:0:9532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b7b7d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d251 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.585185:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7b84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.585197:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7b84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.585218:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7b84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579450.585230:0:9532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787579450.585349:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b7b7d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d251 expref: 57 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.585363:0:9532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7b84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d251 expref: 56 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.585372:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:2.0:1787579450.585375:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787579450.585377:0:9532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319e00, rc 0) 00000100:00100000:2.0:1787579450.585442:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+56:11633:x1874412591734656:12345-192.168.206.53@tcp:101:bash.0 Request processed in 440us (651us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1787579450.585450:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 207 00000100:00100000:1.0:1787579450.592883:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579450.592968:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591734912 00000100:00100000:3.0:1787579450.592979:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591734912 00000100:00100000:3.0:1787579450.593038:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 208 00000100:00100000:3.0:1787579450.593050:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+56:11633:x1874412591734912:12345-192.168.206.53@tcp:36:bash.0 00010000:00010000:3.0:1787579450.593104:0:5866:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787579450.593131:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319e00/0xb72beeaffa1b7b84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d251 expref: 56 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.593151:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7b68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d24a expref: 55 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.593161:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:3.0:1787579450.593166:0:5866:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787579450.593353:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b800/0xb72beeaffa1b7b92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.593366:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b800/0xb72beeaffa1b7b92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.593376:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b800/0xb72beeaffa1b7b92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787579450.593426:0:5866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1787579450.593452:0:5866:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002250ed41 reply state 000000000b365a82 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b800/0xb72beeaffa1b7b92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579450.593473:0:5866:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787579450.593572:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+57:11633:x1874412591734912:12345-192.168.206.53@tcp:36:bash.0 Request processed in 524us (708us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1787579450.593579:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 208 00000020:00080000:3.0:1787579450.593584:0:5866:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787579450.595532:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b800/0xb72beeaffa1b7b92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.595559:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b800/0xb72beeaffa1b7b92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.595567:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b800/0xb72beeaffa1b7b92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.595572:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8b800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579450.595577:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b800/0xb72beeaffa1b7b92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.595605:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b800/0xb72beeaffa1b7b92 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.595620:0:3306:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:2.0:1787579450.595623:0:3306:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579450.595627:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b800/0xb72beeaffa1b7b92 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.595634:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b800/0xb72beeaffa1b7b92 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579450.597534:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579450.597823:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591735040 00000100:00100000:0.0:1787579450.597834:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591735040 00000100:00100000:0.0:1787579450.597892:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 209 00000100:00100000:0.0:1787579450.597902:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+56:11633:x1874412591735040:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:0.0:1787579450.597977:0:9530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579450.597997:0:9530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7b99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d258 expref: -99 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.598077:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7ba0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.598090:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.598100:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579450.598126:0:9530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787579450.598129:0:9530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787579450.598146:0:9530:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.598184:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7b99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d258 expref: 58 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.598201:0:9530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d258 expref: 57 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.598209:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:0.0:1787579450.598212:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787579450.598215:0:9530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c9e00, rc 0) 00000100:00100000:0.0:1787579450.598277:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+57:11633:x1874412591735040:12345-192.168.206.53@tcp:101:bash.0 Request processed in 375us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579450.598284:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 209 00000100:00100000:0.0:1787579450.601399:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579450.601469:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591735296 00000100:00100000:2.0:1787579450.601479:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591735296 00000100:00100000:2.0:1787579450.601532:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 59 00000100:00100000:2.0:1787579450.601541:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+57:11633:x1874412591735296:12345-192.168.206.53@tcp:35:bash.0 00000100:00100000:2.0:1787579450.601763:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+58:11633:x1874412591735296:12345-192.168.206.53@tcp:35:bash.0 Request processed in 221us (370us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1787579450.601772:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 59 00000100:00100000:1.0:1787579450.677639:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579450.678010:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591735424 00000100:00100000:0.0:1787579450.678019:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591735424 00000100:00100000:0.0:1787579450.678118:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 210 00000100:00100000:0.0:1787579450.678128:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+58:11639:x1874412591735424:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1787579450.678150:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579450.678170:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7ba7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d25f expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.678230:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7bae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.678243:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7bae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.678269:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7bae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579450.678324:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787579450.678328:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787579450.678349:0:5868:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7bae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.678374:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7ba7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d25f expref: 60 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.678391:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7bae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d25f expref: 59 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.678400:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:0.0:1787579450.678403:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787579450.678406:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c8e00, rc 0) 00000100:00100000:0.0:1787579450.678468:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+59:11639:x1874412591735424:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 341us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579450.678475:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 210 00000100:00100000:1.0:1787579450.683797:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579450.684406:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591735552 00000100:00100000:2.0:1787579450.684417:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591735552 00000100:00100000:2.0:1787579450.684612:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 211 00000100:00100000:2.0:1787579450.684625:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+59:11639:x1874412591735552:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1787579450.684642:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579450.684662:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b7bb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d266 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.684797:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b7bbc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.684825:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b7bbc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.684836:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b7bbc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.684852:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7bc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.684858:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7bc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.684864:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7bc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.685153:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7bca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.685164:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7bca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.685172:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7bca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579450.685256:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787579450.685260:0:5867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787579450.685275:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7bca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.685286:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7bca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.685305:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b7bbc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.685311:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b7bbc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.685317:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b7bbc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.685323:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318600 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579450.685327:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b7bbc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.685334:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b7bbc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.685346:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:2.0:1787579450.685349:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579450.685353:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b7bbc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.685359:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b7bbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.685370:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7bc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.685377:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7bc3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.685383:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7bc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.685396:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba319200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579450.685400:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7bc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.685405:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7bc3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.685414:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0cea147d700) 00010000:00010000:2.0:1787579450.685416:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579450.685418:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7bc3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.685423:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7bc3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.685454:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b7bb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d266 expref: 61 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.685466:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7bca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d266 expref: 60 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.685473:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:2.0:1787579450.685475:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787579450.685477:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319a00, rc 0) 00000100:00100000:2.0:1787579450.685594:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+60:11639:x1874412591735552:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 972us (1816us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579450.685602:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 211 00000100:00100000:1.0:1787579450.689900:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579450.690044:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579450.690126:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591735936 00000100:00100000:0.0:1787579450.690136:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591735936 00000100:00100000:0.0:1787579450.690198:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 15 00000100:00100000:0.0:1787579450.690208:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+60:2359:x1874412591735936:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579450.690221:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579450.690243:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319a00/0xb72beeaffa1b7bca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d266 expref: 60 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.690272:0:5850:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:0.0:1787579450.690277:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579450.690333:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+59:2359:x1874412591735936:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 127us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579450.690341:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 15 00000100:00100000:2.0:1787579450.691210:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591735808 00000100:00100000:2.0:1787579450.691228:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591735808 00000100:00100000:2.0:1787579450.691307:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 212 00000100:00100000:2.0:1787579450.691316:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba82e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+59:11639:x1874412591735808:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1787579450.691331:0:9532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579450.691347:0:9532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b7bd1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d26d expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.691435:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7bd8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.691449:0:9532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7ba0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d258 expref: 60 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.691458:0:9532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7bd8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.691487:0:9532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d258 expref: 60 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.691500:0:9532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7ba0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d258 expref: 60 pid: 9530 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579450.691513:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab6ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9532:1874412616884992:192.168.206.53@tcp:104: 00000100:00100000:2.0:1787579450.691595:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fbd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787579450.697764:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579450.697866:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab6ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9532:1874412616884992:192.168.206.53@tcp:104: 00010000:00010000:2.0:1787579450.697892:0:9532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7bd8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579450.697991:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591736064 00000100:00100000:3.0:1787579450.697998:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591736064 00010000:00010000:3.0:1787579450.698029:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7ba0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d258 expref: 61 pid: 9530 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579450.698063:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 79 00000100:00100000:3.0:1787579450.698070:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1768380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+61:2360:x1874412591736064:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787579450.698082:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579450.698088:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7ba0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d258 expref: 61 pid: 9530 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.698099:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d258 expref: 61 pid: 9530 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.698118:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7ba0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d258 expref: 61 pid: 9530 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.698132:0:5851:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:3.0:1787579450.698137:0:5851:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7bd8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.698145:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7bd8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.698164:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7bd8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579450.698194:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579450.698238:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1768380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+60:2360:x1874412591736064:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 167us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579450.698245:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 79 00010000:00010000:0.0:1787579450.698299:0:9532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7bd8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.698307:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7bd8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579450.698325:0:9532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787579450.698448:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319000/0xb72beeaffa1b7bd1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d26d expref: 61 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.698461:0:9532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7bd8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d26d expref: 60 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.698468:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:0.0:1787579450.698471:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787579450.698473:0:9532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319200, rc 0) 00000100:00100000:0.0:1787579450.698494:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba82e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+60:11639:x1874412591735808:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 7181us (8666us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1787579450.698501:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 212 00000100:00100000:1.0:1787579450.701565:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579450.704659:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591736320 00000100:00100000:0.0:1787579450.704674:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591736320 00000100:00100000:0.0:1787579450.705462:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00100000:0.0:1787579450.705490:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec176ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+60:11639:x1874412591736320:12345-192.168.206.53@tcp:103:lfs.0 00010000:00010000:0.0:1787579450.705508:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579450.705532:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a000/0xb72beeaffa1b7b37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d243 expref: 60 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.705566:0:5850:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:0.0:1787579450.705571:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579450.705632:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec176ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+59:11639:x1874412591736320:12345-192.168.206.53@tcp:103:lfs.0 Request processed in 146us (4088us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579450.705640:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00100000:1.0:1787579450.708183:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579450.708449:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591736448 00000100:00100000:0.0:1787579450.708459:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591736448 00000100:00100000:0.0:1787579450.708514:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 213 00000100:00100000:0.0:1787579450.708525:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec176b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+59:11639:x1874412591736448:12345-192.168.206.53@tcp:58:lfs.0 00010000:00010000:0.0:1787579450.708628:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7be6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.708644:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7be6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579450.708656:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7be6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787579450.708849:0:5868:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1787579450.708972:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec176b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+59:11639:x1874412591736448:12345-192.168.206.53@tcp:58:lfs.0 Request processed in 449us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579450.708980:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 213 00000100:00100000:1.0:1787579450.712824:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579450.712919:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591736576 00000100:00100000:2.0:1787579450.712974:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591736576 00000100:00100000:2.0:1787579450.713025:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 214 00000100:00100000:2.0:1787579450.713035:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfb3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+59:11639:x1874412591736576:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1787579450.713053:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579450.713072:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7bed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d274 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.713125:0:5867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7be6 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.713136:0:5867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7bed lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d274 expref: 60 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.713155:0:5867:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7be6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.713167:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7bed lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d274 expref: 60 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.713181:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:2.0:1787579450.713183:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787579450.713187:0:5867:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7bed lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d274 expref: 60 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579450.713194:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba318400, rc 0) 00000100:00100000:2.0:1787579450.713240:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfb3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+60:11639:x1874412591736576:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 207us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579450.713247:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 214 00010000:00010000:3.0:1787579450.785012:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579451.061189:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579451.061233:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579451.061267:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579451.061303:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579451.061336:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591737088 00000100:00100000:2.0:1787579451.061345:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591737088 00000100:00100000:2.0:1787579451.061399:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591736960 00000100:00100000:2.0:1787579451.061402:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591736960 00000100:00100000:2.0:1787579451.061427:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 68 00000100:00100000:2.0:1787579451.061436:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+9:2362:x1874412591737088:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1787579451.061500:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+9:2362:x1874412591737088:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 65us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579451.061507:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 68 00000100:00100000:3.0:1787579451.062136:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 69 00000100:00100000:3.0:1787579451.062148:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+7:2362:x1874412591736960:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1787579451.062183:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+7:2362:x1874412591736960:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 39us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579451.062190:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 69 00000100:00080000:3.0:1787579451.062227:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787579451.062232:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787579451.062264:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579451.062355:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591736832 00000100:00100000:3.0:1787579451.062361:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591736832 00000100:00100000:3.0:1787579451.062392:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591737216 00000100:00100000:3.0:1787579451.062395:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591737216 00000100:00100000:3.0:1787579451.062415:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 146 00000100:00100000:3.0:1787579451.062422:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+60:2362:x1874412591736832:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1787579451.062457:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+60:2362:x1874412591736832:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 35us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579451.062463:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 146 00000100:00100000:3.0:1787579451.062476:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 147 00000100:00100000:3.0:1787579451.062495:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec16b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2362:x1874412591737216:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1787579451.063833:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec16b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2362:x1874412591737216:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 1332us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579451.063844:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 147 00000100:00080000:3.0:1787579451.063872:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579451.064253:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591736704 00000100:00100000:1.0:1787579451.064261:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591736704 00000100:00100000:1.0:1787579451.064297:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 293 00000100:00100000:1.0:1787579451.064306:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+13:2362:x1874412591736704:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579451.064378:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+13:2362:x1874412591736704:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 73us (3109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579451.064385:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 293 00000100:00100000:2.0:1787579451.360835:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616885248:0@lo:400:kworker.0 00000100:00100000:1.0:1787579451.360898:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616885504:0@lo:400:kworker.0 00000100:00100000:2.0:1787579451.360918:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579451.360983:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616885120:0@lo:400:kworker.0 00000100:00100000:1.0:1787579451.362038:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579451.362117:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1874412616885376:0@lo:400:kworker.0 00000004:00080000:3.0:1787579451.363402:0:7659:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 387554473751ns, next at 388554471497ns, rc = 0 00000100:00100000:3.0:1787579451.363434:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616885248 00000100:00100000:3.0:1787579451.363441:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616885248 00000100:00100000:3.0:1787579451.363491:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787579451.363500:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1ad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616885248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579451.363565:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1ad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616885248:12345-0@lo:400:kworker.0 Request processed in 66us (2646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579451.363572:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787579451.363615:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616885504 00000100:00100000:3.0:1787579451.363620:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616885504 00000100:00100000:3.0:1787579451.363645:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787579451.363652:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfb3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3321:x1874412616885504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579451.363686:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfb3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3321:x1874412616885504:12345-0@lo:400:kworker.0 Request processed in 35us (1651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579451.363691:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787579451.363726:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616885504:0@lo:400:kworker.0 00000100:00100000:1.0:1787579451.365041:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579451.365137:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec16b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616885888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787579451.365969:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579451.366035:0:7952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616885888 00000100:00100000:1.0:1787579451.366041:0:7952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616885888 00000100:00100000:1.0:1787579451.366092:0:7952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787579451.366100:0:7952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfb3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1874412616885888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787579451.366130:0:7952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787579451.366261:0:7952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfb3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1874412616885888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579451.366268:0:7952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787579451.366397:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec16b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616885888:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787579451.366427:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787579451.367953:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616885376 00000100:00100000:3.0:1787579451.367963:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616885376 00000100:00100000:0.0:1787579451.368044:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579451.368080:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787579451.368083:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616885632:0@lo:400:kworker.0 00000100:00100000:3.0:1787579451.368088:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfb3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874412616885376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579451.368132:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfb3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874412616885376:12345-0@lo:400:kworker.0 Request processed in 45us (3095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579451.368138:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579451.368163:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787579451.368180:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616885632 00000100:00100000:3.0:1787579451.368183:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616885632 00000100:00100000:0.0:1787579451.368185:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616885120 00000100:00100000:0.0:1787579451.368188:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616885120 00000100:00100000:0.0:1787579451.368209:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787579451.368210:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787579451.368215:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8565e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3322:x1874412616885120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579451.368216:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3322:x1874412616885632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579451.368249:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3322:x1874412616885632:12345-0@lo:400:kworker.0 Request processed in 33us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579451.368251:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8565e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3322:x1874412616885120:12345-0@lo:400:kworker.0 Request processed in 37us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579451.368255:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787579451.368257:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787579451.368291:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616885120:0@lo:400:kworker.0 00000100:00100000:0.0:1787579451.368302:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616885632:0@lo:400:kworker.0 00000100:00100000:3.0:1787579451.368313:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1874412616885376:0@lo:400:kworker.0 00000100:00100000:2.0:1787579451.369249:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616885248:0@lo:400:kworker.0 00000100:00100000:2.0:1787579451.369260:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1874412616885760:0@lo:400:kworker.0 00000100:00080000:1.0:1787579451.369269:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787579451.369293:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579451.369383:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616885760 00000100:00100000:0.0:1787579451.369388:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616885760 00000100:00100000:0.0:1787579451.369435:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787579451.369443:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874412616885760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579451.369489:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874412616885760:12345-0@lo:400:kworker.0 Request processed in 47us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579451.369495:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:1.0:1787579451.369547:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787579451.369737:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1874412616885760:0@lo:400:kworker.0 00000040:00080000:2.0:1787579451.616209:0:11712:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787579451.616217:0:11712:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787579451.616249:0:11712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1787579451.616256:0:11712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787579451.616377:0:11712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1ad0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11712:1874412616886016:192.168.206.53@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787579451.616546:0:11712:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fbd480 going to sleep for 11 seconds 00000100:00100000:2.0:1787579451.623893:0:11712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1ad0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11712:1874412616886016:192.168.206.53@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787579451.629294:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579451.631276:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591737344 00000100:00100000:0.0:1787579451.631290:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591737344 00000100:00100000:0.0:1787579451.631377:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 215 00000100:00100000:0.0:1787579451.631388:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec16b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+60:11641:x1874412591737344:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787579451.631446:0:5868:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787579451.633298:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec16b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+60:11641:x1874412591737344:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 Request processed in 1904us (4005us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579451.633324:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 215 00000100:00100000:1.0:1787579451.647234:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579451.647370:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591737472 00000100:00100000:3.0:1787579451.647380:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591737472 00000100:00100000:3.0:1787579451.647440:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 216 00000100:00100000:3.0:1787579451.647450:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfb3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+60:11641:x1874412591737472:12345-192.168.206.53@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787579451.647517:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7bf4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647532:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7bf4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647544:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7bf4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647567:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7bfb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647574:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7bfb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647600:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7bfb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647625:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647634:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647640:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579451.647676:0:9530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787579451.647679:0:9530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787579451.647691:0:9530:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647701:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7bf4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647718:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7bf4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647726:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7bf4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647732:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8a800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579451.647736:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7bf4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647742:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7bf4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647760:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0ce84d55300) 00010000:00010000:3.0:1787579451.647763:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579451.647768:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7bf4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647786:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7bf4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647801:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7bfb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647807:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7bfb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647813:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7bfb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647817:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8b000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579451.647821:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7bfb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647827:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7bfb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647834:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffffa0ce84d55b00) 00010000:00010000:3.0:1787579451.647836:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579451.647839:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7bfb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647844:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7bfb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647868:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647874:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647880:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647885:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8bc00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579451.647888:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647893:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647900:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:3.0:1787579451.647902:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579451.647905:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c02 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.647910:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579451.648022:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfb3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+60:11641:x1874412591737472:12345-192.168.206.53@tcp:34:lhsmtool_posix.0 Request processed in 572us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579451.648029:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 216 00000100:00100000:1.0:1787579451.652482:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579451.652557:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591737728 00000100:00100000:3.0:1787579451.652567:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591737728 00000100:00100000:3.0:1787579451.652622:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 217 00000100:00100000:3.0:1787579451.652645:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfb3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+60:11641:x1874412591737728:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787579451.652664:0:5866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579451.652684:0:5866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c09 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d27b expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.652792:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7c10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.652806:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7c10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.652817:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7c10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579451.652827:0:5866:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787579451.652913:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7c10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.652921:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7c10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.653107:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7c10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.653114:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8b000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579451.653119:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7c10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.653127:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7c10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.653138:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:3.0:1787579451.653148:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787579451.653153:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7c10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.653160:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7c10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.653364:0:5866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c09 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d27b expref: 62 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.653375:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0ce84d55300) 00010000:00010000:3.0:1787579451.653377:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787579451.653380:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c09 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d27b expref: 62 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.653390:0:5866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce90a8bc00, rc 0) 00000100:00100000:3.0:1787579451.653496:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfb3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+61:11641:x1874412591737728:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 852us (1022us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1787579451.653504:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 217 00000100:00100000:1.0:1787579451.663676:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579451.663747:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591737856 00000100:00100000:0.0:1787579451.663757:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591737856 00000100:00100000:0.0:1787579451.663824:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 218 00000100:00100000:0.0:1787579451.663846:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfb3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+61:11641:x1874412591737856:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787579451.663879:0:5868:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787579451.663998:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfb3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+61:11641:x1874412591737856:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 Request processed in 164us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579451.664005:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 218 00000100:00100000:2.0:1787579451.673452:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579451.673574:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591738112 00000100:00100000:0.0:1787579451.673585:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591738112 00000100:00100000:0.0:1787579451.674087:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 219 00000100:00100000:0.0:1787579451.674100:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+61:11641:x1874412591738112:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787579451.674120:0:9532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579451.674123:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787579451.674149:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8e00/0xb72beeaffa1b7bae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d25f expref: 61 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.674169:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:0.0:1787579451.674173:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787579451.674197:0:9532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7c1e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d282 expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787579451.674609:0:9532:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1787579451.674821:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7c25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.674853:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7c25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.674863:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7c25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.675243:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7c1e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d282 expref: 63 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.675263:0:9532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7c25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d282 expref: 62 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.675271:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0ce82cbb000) 00010000:00010000:0.0:1787579451.675274:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787579451.675336:0:9532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c9600, rc 0) 00000100:00100000:0.0:1787579451.675409:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+62:11641:x1874412591738112:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 1312us (1966us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1787579451.675418:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 219 00000100:00100000:1.0:1787579451.682753:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579451.683300:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591738368 00000100:00100000:3.0:1787579451.683311:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591738368 00000100:00100000:3.0:1787579451.683371:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 220 00000100:00100000:3.0:1787579451.683381:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfb3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+62:11641:x1874412591738368:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787579451.683436:0:5866:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579451.683462:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b7c25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d282 expref: 62 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.683480:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0ce82cbb000) 00010000:00010000:3.0:1787579451.683501:0:5866:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787579451.683521:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c33 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.683535:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c33 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.683546:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c33 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.683559:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7c3a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x6ca092c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.683566:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7c3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6ca092c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.683572:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7c3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6ca092c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.684892:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c33 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.684905:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c33 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.684913:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c33 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.684919:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8bc00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579451.685081:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c33 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.685092:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c33 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.685121:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:3.0:1787579451.685124:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579451.685129:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c33 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.685136:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c33 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.685150:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7c3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6ca092c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.685157:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7c3a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6ca092c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.685163:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7c3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6ca092c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.685168:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8b000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579451.685171:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7c3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6ca092c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.685177:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7c3a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6ca092c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.685184:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x6ca092c0 (ffffa0ce84d55b00) 00010000:00010000:3.0:1787579451.685187:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579451.685189:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7c3a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6ca092c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.685194:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7c3a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6ca092c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579451.688115:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfb3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+61:11641:x1874412591738368:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 4722us (5360us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787579451.688129:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 220 00000100:00100000:1.0:1787579451.695035:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579451.695069:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591738496 00000100:00100000:3.0:1787579451.695078:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591738496 00000100:00100000:3.0:1787579451.695136:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 221 00000100:00100000:3.0:1787579451.695147:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfb3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+61:11641:x1874412591738496:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787579451.695168:0:9530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579451.695273:0:9530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7c41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d289 expref: -99 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.695323:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.695337:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.695348:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.695467:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7c41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d289 expref: 63 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.695485:0:9530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d289 expref: 62 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.695493:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:3.0:1787579451.695496:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787579451.695499:0:9530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce90a8bc00, rc 0) 00000100:00100000:3.0:1787579451.695601:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfb3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+62:11641:x1874412591738496:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 456us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579451.695618:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 221 00000100:00100000:3.0:1787579451.700867:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579451.701051:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591738752 00000100:00100000:0.0:1787579451.701061:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591738752 00000100:00100000:0.0:1787579451.701118:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 222 00000100:00100000:0.0:1787579451.701128:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec16b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+62:11641:x1874412591738752:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787579451.701204:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7c4f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.701220:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7c4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.701251:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7c4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787579451.701503:0:9532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:0.0:1787579451.701606:0:9532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc5ea35c reply state 00000000353e2c28 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7c4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579451.701615:0:9532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787579451.702092:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec16b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+64:11641:x1874412591738752:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 963us (1232us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1787579451.702101:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 222 00010000:00010000:0.0:1787579451.707062:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7c4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.707078:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7c4f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.707086:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7c4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.707092:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579451.707097:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7c4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.707104:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7c4f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.708042:0:3305:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:0.0:1787579451.708051:0:3305:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787579451.708058:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7c4f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.708084:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9000/0xb72beeaffa1b7c4f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579451.708297:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579451.708389:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591738880 00000100:00100000:2.0:1787579451.708400:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591738880 00000100:00100000:2.0:1787579451.708459:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 223 00000100:00100000:2.0:1787579451.708469:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfb3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+63:11641:x1874412591738880:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787579451.708493:0:5866:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579451.708509:0:5866:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7c56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d290 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.708573:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7c56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d290 expref: 64 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.708587:0:5866:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7c56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d290 expref: 64 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.708604:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:2.0:1787579451.708607:0:5866:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787579451.708610:0:5866:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319600, rc 0) 00000100:00100000:2.0:1787579451.708664:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfb3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+64:11641:x1874412591738880:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 196us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579451.708671:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 223 00000100:00100000:0.0:1787579451.716300:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579451.716366:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591739008 00000100:00100000:3.0:1787579451.716375:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591739008 00000100:00100000:3.0:1787579451.716435:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 64 00000100:00100000:3.0:1787579451.716445:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+9:2360:x1874412591739008:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787579451.717296:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+10:2360:x1874412591739008:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 Request processed in 848us (1002us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1787579451.717307:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 64 00000100:00100000:0.0:1787579451.720383:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579451.720466:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591739264 00000100:00100000:2.0:1787579451.720477:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591739264 00000100:00100000:2.0:1787579451.720554:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 60 00000100:00100000:2.0:1787579451.720565:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+64:11641:x1874412591739264:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787579451.720846:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+65:11641:x1874412591739264:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 Request processed in 283us (471us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1787579451.720854:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 60 00000100:00100000:1.0:1787579451.726169:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579451.726420:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591739520 00000100:00100000:0.0:1787579451.726441:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591739520 00000100:00100000:0.0:1787579451.726527:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 224 00000100:00100000:0.0:1787579451.726538:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfb3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+65:11641:x1874412591739520:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787579451.726674:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfb3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+65:11641:x1874412591739520:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 138us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579451.726682:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 224 00000100:00100000:1.0:1787579451.731461:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579451.732308:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591739648 00000100:00100000:3.0:1787579451.732320:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591739648 00000100:00100000:3.0:1787579451.732383:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 225 00000100:00100000:3.0:1787579451.732394:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfb3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+65:11641:x1874412591739648:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787579451.732412:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579451.732433:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7c5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d297 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.732523:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7c64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.732538:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7c64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.732559:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7c64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579451.732595:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787579451.732619:0:5868:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7c64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.732645:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b000/0xb72beeaffa1b7c5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d297 expref: 67 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.732664:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7c64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d297 expref: 66 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.732672:0:5868:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:3.0:1787579451.732675:0:5868:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787579451.732678:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce90a8a800, rc 0) 00000100:00100000:3.0:1787579451.732838:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfb3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:963d8c17-1326-491b-be60-9002b9296555+66:11641:x1874412591739648:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 446us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579451.732845:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 225 00000100:00100000:1.0:1787579451.738802:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579451.738881:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591739776 00000100:00100000:3.0:1787579451.738891:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591739776 00000100:00100000:3.0:1787579451.738973:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 65 00000100:00100000:3.0:1787579451.738983:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfb3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+10:2359:x1874412591739776:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787579451.738999:0:7660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579451.739019:0:7660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c6b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d29e expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787579451.739045:0:7660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c4c3a, blocks: 0x1 00010000:00010000:3.0:1787579451.739064:0:7660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=387s v=(0 0) 00010000:00010000:3.0:1787579451.739069:0:7660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579451.739079:0:7660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d29e expref: 11 pid: 7660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.739117:0:7660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d29e expref: 11 pid: 7660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.739142:0:7660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce90a8b000, rc 0) 00000100:00100000:3.0:1787579451.739197:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfb3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+11:2359:x1874412591739776:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 214us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579451.739203:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 65 00000100:00100000:1.0:1787579451.746641:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579451.746824:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591740032 00000100:00100000:0.0:1787579451.746833:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591740032 00000100:00100000:0.0:1787579451.746889:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 226 00000100:00100000:0.0:1787579451.746900:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfb3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+66:11641:x1874412591740032:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787579451.747033:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfb3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+66:11641:x1874412591740032:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 134us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579451.747041:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 226 00000100:00100000:1.0:1787579451.754398:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579451.754486:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591740160 00000100:00100000:2.0:1787579451.754496:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591740160 00000100:00100000:2.0:1787579451.754562:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 66 00000100:00100000:2.0:1787579451.754572:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfb3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+11:11641:x1874412591740160:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787579451.754588:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579451.754605:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000758c461/0xb72beeaffa1b7c72 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d2a5 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.754634:0:6712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c6b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d29e expref: 12 pid: 7660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.754644:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579451.754648:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579451.754654:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000758c461/0xb72beeaffa1b7c72 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2a5 expref: 12 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.754687:0:6712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d29e expref: 12 pid: 7660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.754700:0:6712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d29e expref: 12 pid: 7660 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579451.754733:0:6712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1ad1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6712:1874412616886144:192.168.206.53@tcp:104: 00000100:00100000:2.0:1787579451.754827:0:6712:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fbd480 going to sleep for 11 seconds 00000100:00100000:2.0:1787579451.760013:0:6712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1ad1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6712:1874412616886144:192.168.206.53@tcp:104: 00010000:00010000:2.0:1787579451.760050:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000758c461/0xb72beeaffa1b7c72 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2a5 expref: 12 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.760073:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba318200, rc 0) 00000100:00100000:2.0:1787579451.760174:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfb3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+12:11641:x1874412591740160:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 5602us (5782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579451.760184:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 66 00000100:00100000:0.0:1787579451.762186:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579451.762251:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591740288 00000100:00100000:3.0:1787579451.762261:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591740288 00010000:00010000:3.0:1787579451.762299:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d29e expref: 12 pid: 7660 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579451.762338:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 80 00000100:00100000:3.0:1787579451.762346:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce831d5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+12:2360:x1874412591740288:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787579451.762358:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579451.762379:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d29e expref: 12 pid: 7660 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.762392:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d29e expref: 12 pid: 7660 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.762415:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c6b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d29e expref: 12 pid: 7660 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.762448:0:5851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579451.762453:0:5851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579451.762461:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000758c461/0xb72beeaffa1b7c72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2a5 expref: 11 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.762471:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000758c461/0xb72beeaffa1b7c72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2a5 expref: 11 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.762570:0:5851:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000758c461/0xb72beeaffa1b7c72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2a5 expref: 11 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579451.762598:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec16b6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5851:1874412616886272:192.168.206.53@tcp:105: 00000100:00100000:2.0:1787579451.763120:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cd833f5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787579451.766170:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec16b6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5851:1874412616886272:192.168.206.53@tcp:105: 00010000:00010000:2.0:1787579451.766197:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579451.766315:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce831d5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+11:2360:x1874412591740288:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 3968us (4134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579451.766326:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 80 00000100:00100000:3.0:1787579451.772447:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579451.777650:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591740416 00000100:00100000:0.0:1787579451.777663:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591740416 00002000:00100000:0.0:1787579451.777714:0:6716:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffffa0cec16b4e00 x1874412591740416/t0(0) o4->963d8c17-1326-491b-be60-9002b9296555@192.168.206.53@tcp:692/0 lens 504/0 e 0 to 0 dl 1787579462 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787579451.777725:0:6716:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0cec16b4e00 with x1874412591740416 ext(0->12) 00002000:00010000:0.0:1787579451.777741:0:6716:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0cec16b4e00 00000100:00100000:0.0:1787579451.777784:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:0.0:1787579451.777795:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec16b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:963d8c17-1326-491b-be60-9002b9296555+11:2359:x1874412591740416:12345-192.168.206.53@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787579451.778220:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec16b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:963d8c17-1326-491b-be60-9002b9296555+13:2359:x1874412591740416:12345-192.168.206.53@tcp:4:lhsmtool_posix.0 Request processed in 426us (5782us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1787579451.778228:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 7 00002000:00100000:0.0:1787579451.778236:0:6716:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffffa0cec16b4e00 x1874412591740416/t4294967321(0) o4->963d8c17-1326-491b-be60-9002b9296555@192.168.206.53@tcp:692/0 lens 504/448 e 0 to 0 dl 1787579462 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787579451.778243:0:6716:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0cec16b4e00 with x1874412591740416 ext(0->12) 00002000:00010000:0.0:1787579451.778247:0:6716:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0cec16b4e00 00000100:00100000:1.0:1787579451.786362:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579451.786483:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591740544 00000100:00100000:2.0:1787579451.786495:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591740544 00000100:00100000:2.0:1787579451.786575:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 227 00000100:00100000:2.0:1787579451.786587:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfb3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+66:11641:x1874412591740544:12345-192.168.206.53@tcp:44:lhsmtool_posix.0 00010000:00010000:3.0:1787579451.816171:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579451.869641:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfb3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+66:11641:x1874412591740544:12345-192.168.206.53@tcp:44:lhsmtool_posix.0 Request processed in 83047us (83285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579451.869655:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 227 00000001:00080000:3.0:1787579451.869692:0:5888:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:3.0:1787579451.869737:0:5888:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1787579451.869754:0:5888:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0ce92d47f00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1787579451.869758:0:5888:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0ceb405cd00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0ce92d47d80 00000020:00080000:3.0:1787579451.869761:0:5888:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0ceb405cb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0cebf65d000 00000001:00080000:3.0:1787579451.869790:0:5888:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1787579451.869808:0:5888:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:3.0:1787579451.869847:0:5888:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:3.0:1787579451.869862:0:5888:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:3.0:1787579451.869900:0:5888:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0cd833f5900 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1787579451.869904:0:5888:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0cea4cb7000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0cd833f5240 00000020:00080000:3.0:1787579451.869907:0:5888:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0cea4cb7900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0cec18fac00 00000020:00080000:3.0:1787579451.870104:0:5899:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:1.0:1787579451.870231:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec16b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616886400:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787579451.870332:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1787579451.871611:0:5899:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787579451.871990:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787579451.872018:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616886400 00000100:00100000:1.0:1787579451.872019:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec16b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616886528:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787579451.872029:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616886400 00000100:00100000:3.0:1787579451.872091:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787579451.872099:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579451.872106:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfb3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3321:x1874412616886400:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787579451.872134:0:7660:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1787579451.872166:0:7660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8c4c39, atime: 0x6a8c4c39, ctime: 0x6a8c4c39, blocks: 0x1 00010000:00010000:3.0:1787579451.872174:0:7660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004be28bd9/0xb72beeaffa1b7c79 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.872187:0:7660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=388s v=(0 0) 00010000:00010000:3.0:1787579451.872192:0:7660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579451.872198:0:7660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004be28bd9/0xb72beeaffa1b7c79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.872213:0:7660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004be28bd9/0xb72beeaffa1b7c79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.872223:0:7660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004be28bd9/0xb72beeaffa1b7c79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.872245:0:7660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004be28bd9/0xb72beeaffa1b7c79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.872284:0:7660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787579451.872410:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787579451.872421:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004be28bd9/0xb72beeaffa1b7c79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579451.872435:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8be00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:1.0:1787579451.872441:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004be28bd9/0xb72beeaffa1b7c79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579451.872465:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004be28bd9/0xb72beeaffa1b7c79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579451.872487:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004be28bd9/0xb72beeaffa1b7c79 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579451.872494:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004be28bd9/0xb72beeaffa1b7c79 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579451.872536:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579451.872539:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579451.872543:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579451.872907:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfb3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3321:x1874412616886400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 805us (2574us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787579451.872917:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787579451.872963:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616886528 00000100:00100000:3.0:1787579451.872969:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616886528 00000100:00100000:3.0:1787579451.873003:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000004:00080000:1.0:1787579451.873009:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0cec16b5880/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787579451.873012:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfb3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3321:x1874412616886528:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787579451.873022:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec16b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616886400:0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787579451.873032:0:7660:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1787579451.873049:0:7660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.873064:0:7660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000059f8bded/0xb72beeaffa1b7a3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d204 expref: 12 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.873072:0:7660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1787579451.873076:0:7660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787579451.873080:0:7660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c80 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.873107:0:7660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000059f8bded/0xb72beeaffa1b7a3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d204 expref: 12 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.873136:0:7660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000059f8bded/0xb72beeaffa1b7a3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d204 expref: 12 pid: 6710 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579451.873151:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec16b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7660:1874412616886656:192.168.206.53@tcp:104: 00000100:00100000:3.0:1787579451.873400:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cd833f5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787579451.873494:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579451.873559:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591740672 00000100:00100000:3.0:1787579451.873563:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591740672 00000100:00100000:3.0:1787579451.873586:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 69 00000100:00100000:3.0:1787579451.873592:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec16b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+13:2360:x1874412591740672:12345-192.168.206.53@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787579451.876188:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579451.876218:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591740800 00000100:00100000:3.0:1787579451.876225:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591740800 00010000:00010000:3.0:1787579451.876415:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000059f8bded/0xb72beeaffa1b7a3b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d204 expref: 14 pid: 6710 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579451.876453:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 81 00000100:00100000:3.0:1787579451.876464:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec16b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+14:2360:x1874412591740800:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787579451.876477:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579451.876484:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000059f8bded/0xb72beeaffa1b7a3b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d204 expref: 14 pid: 6710 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.876498:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000059f8bded/0xb72beeaffa1b7a3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d204 expref: 14 pid: 6710 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.876532:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787579451.876537:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787579451.876543:0:8477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.876553:0:8477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c80 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.876573:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579451.876625:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec16b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+14:2360:x1874412591740800:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 163us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579451.876634:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 81 00010000:00010000:3.0:1787579451.876748:0:7660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059f8bded/0xb72beeaffa1b7a3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d204 expref: 13 pid: 6710 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579451.876763:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec16b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7660:1874412616886656:192.168.206.53@tcp:104: 00010000:00010000:3.0:1787579451.876794:0:7660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.876805:0:7660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.876812:0:7660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.876834:0:7660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.876842:0:7660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.876860:0:7660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787579451.880007:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616886784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787579451.880073:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579451.880201:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616886784 00000100:00100000:0.0:1787579451.880208:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616886784 00000100:00100000:0.0:1787579451.880475:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787579451.880485:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3319:x1874412616886784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787579451.880516:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579451.880574:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3319:x1874412616886784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579451.880582:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787579451.880894:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616886784:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787579451.881510:0:8475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787579451.881519:0:8475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.881533:0:8475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8b000 already unused, calling callback (ffffffffc1654230) 00010000:00010000:3.0:1787579451.881539:0:8475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.881552:0:8475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.881575:0:8475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c80 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.881584:0:8475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.881605:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579451.881621:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579451.881623:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579451.881877:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfb3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3321:x1874412616886528:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8865us (9779us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1787579451.881885:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:1.0:1787579451.883091:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0cec16b7b80/2, rc 0, transno 4294967322 00000100:00100000:1.0:1787579451.883120:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec16b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616886528:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1787579451.920397:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:1.0:1787579451.920423:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000100:00100000:0.0:1787579451.920579:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec16b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+7:2360:x1874412591740672:12345-192.168.206.53@tcp:16:lhsmtool_posix.0 Request processed in 46980us (47079us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579451.920590:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 69 00000100:00100000:3.0:1787579451.924655:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579451.925007:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591741056 00000100:00100000:2.0:1787579451.925018:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591741056 00000100:00100000:2.0:1787579451.925105:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 228 00000100:00100000:2.0:1787579451.925116:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec16b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+20:11641:x1874412591741056:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787579451.925205:0:5866:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579451.925241:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a800/0xb72beeaffa1b7c64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d297 expref: 20 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.925267:0:5866:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:2.0:1787579451.925273:0:5866:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787579451.925313:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7c87 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.925329:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7c87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.925340:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7c87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787579451.925864:0:5866:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f513834 reply state 00000000551b8662 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7c87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579451.926158:0:5866:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787579451.926288:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec16b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+21:11641:x1874412591741056:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 1171us (1645us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787579451.926298:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 228 00010000:00010000:1.0:1787579451.928465:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7c87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579451.928483:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7c87 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579451.928492:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7c87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579451.928507:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00010000:00010000:1.0:1787579451.928525:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579451.928531:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7c87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579451.928540:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7c87 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579451.928560:0:3306:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:1.0:1787579451.928564:0:3306:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787579451.928569:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591741184 00010000:00010000:1.0:1787579451.928570:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7c87 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579451.928584:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591741184 00000100:00100000:3.0:1787579451.928651:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 70 00000100:00100000:3.0:1787579451.928662:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1ad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+7:2360:x1874412591741184:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787579451.928952:0:6711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787579451.928956:0:6711:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787579449 00002000:00010000:3.0:1787579451.928959:0:6711:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787579449 00002000:00010000:3.0:1787579451.928961:0:6711:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787579450 -> 1787579449 00002000:00010000:3.0:1787579451.928963:0:6711:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787579451.929031:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1ad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+8:2360:x1874412591741184:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 Request processed in 370us (536us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787579451.929040:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 70 00010000:00010000:1.0:1787579451.929609:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318800/0xb72beeaffa1b7c87 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579451.931999:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579451.932163:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591741440 00000100:00100000:3.0:1787579451.932172:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591741440 00000100:00100000:3.0:1787579451.932234:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 229 00000100:00100000:3.0:1787579451.932243:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfb3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+20:11641:x1874412591741440:12345-192.168.206.53@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787579451.932526:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7c8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.932544:0:9530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d289 expref: 20 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.932572:0:9530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7c8e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.932609:0:9530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d289 expref: 20 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.932623:0:9530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d289 expref: 20 pid: 9530 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579451.932638:0:9530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec16b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9530:1874412616886912:192.168.206.53@tcp:104: 00000100:00100000:3.0:1787579451.932798:0:9530:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cd833f5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787579451.937133:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579451.937266:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591741568 00000100:00100000:0.0:1787579451.937282:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591741568 00000100:00100000:3.0:1787579451.937308:0:9530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec16b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9530:1874412616886912:192.168.206.53@tcp:104: 00010000:00010000:0.0:1787579451.937332:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d289 expref: 21 pid: 9530 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.937346:0:9530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7c8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579451.937386:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 82 00000100:00100000:0.0:1787579451.937397:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:963d8c17-1326-491b-be60-9002b9296555+21:2360:x1874412591741568:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579451.937412:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579451.937421:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d289 expref: 21 pid: 9530 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.937435:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d289 expref: 21 pid: 9530 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.937456:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8bc00/0xb72beeaffa1b7c48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d289 expref: 21 pid: 9530 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.937471:0:5852:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:0.0:1787579451.937476:0:5852:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7c8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.937485:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7c8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.937492:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7c8e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.937519:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787579451.937561:0:9530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7c8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.937571:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7c8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579451.937582:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:963d8c17-1326-491b-be60-9002b9296555+20:2360:x1874412591741568:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 184us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579451.937604:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 82 00010000:00010000:3.0:1787579451.937611:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7c8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.937622:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7c8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.937630:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7c8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.937651:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8ba00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579451.937657:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7c8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.937665:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7c8e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.937682:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:3.0:1787579451.937685:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787579451.937690:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7c8e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.937696:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7c8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579451.938216:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfb3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+19:11641:x1874412591741440:12345-192.168.206.53@tcp:55:lhsmtool_posix.0 Request processed in 5969us (6220us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787579451.938227:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 229 00000100:00100000:2.0:1787579451.942010:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579451.942378:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591741696 00000100:00100000:3.0:1787579451.942389:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591741696 00000100:00100000:3.0:1787579451.942442:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 71 00000100:00100000:3.0:1787579451.942451:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+8:2360:x1874412591741696:12345-192.168.206.53@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787579451.942501:0:7660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c95 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.942586:0:7660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000758c461/0xb72beeaffa1b7c72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2a5 expref: 8 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.942619:0:7660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787579451.942624:0:7660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787579451.942630:0:7660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c95 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.942675:0:7660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000758c461/0xb72beeaffa1b7c72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2a5 expref: 8 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.942691:0:7660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000758c461/0xb72beeaffa1b7c72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2a5 expref: 8 pid: 6712 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579451.942708:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec16b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7660:1874412616887040:192.168.206.53@tcp:104: 00000100:00100000:3.0:1787579451.942815:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cd833f5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787579451.945474:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec16b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7660:1874412616887040:192.168.206.53@tcp:104: 00010000:00010000:3.0:1787579451.945513:0:7660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c95 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579451.950016:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579451.951431:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591741824 00000100:00100000:3.0:1787579451.951447:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591741824 00010000:00010000:3.0:1787579451.951504:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000758c461/0xb72beeaffa1b7c72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2a5 expref: 9 pid: 6712 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579451.951696:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 83 00000100:00100000:3.0:1787579451.951887:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+9:2359:x1874412591741824:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787579451.951963:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579451.952480:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000758c461/0xb72beeaffa1b7c72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2a5 expref: 9 pid: 6712 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.952500:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000758c461/0xb72beeaffa1b7c72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2a5 expref: 9 pid: 6712 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.952653:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000758c461/0xb72beeaffa1b7c72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2a5 expref: 9 pid: 6712 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.953362:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787579451.953368:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787579451.953376:0:8477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c95 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.953390:0:8477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c95 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.953451:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787579451.953701:0:7660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c95 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.953789:0:7660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c95 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.953829:0:7660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c95 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.953838:0:7660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c95 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.953846:0:7660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.953854:0:7660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8b000 already unused, calling callback (ffffffffc1654230) 00010000:00010000:0.0:1787579451.953860:0:7660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.953869:0:7660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.953883:0:7660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c95 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.953914:0:7660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069161f7f/0xb72beeaffa1b7c95 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579451.954126:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:963d8c17-1326-491b-be60-9002b9296555+8:2359:x1874412591741824:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 2416us (4127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579451.954140:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 83 00000100:00100000:0.0:1787579451.954405:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+7:2360:x1874412591741696:12345-192.168.206.53@tcp:1:lhsmtool_posix.0 Request processed in 11953us (12408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579451.954415:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 71 00000100:00100000:0.0:1787579451.957599:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579451.957719:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591742080 00000100:00100000:3.0:1787579451.957728:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591742080 00000100:00100000:3.0:1787579451.957790:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 230 00000100:00100000:3.0:1787579451.957799:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+19:11641:x1874412591742080:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787579451.957883:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7c9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.957898:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7c9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.957909:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7c9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.958134:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8aa00/0xb72beeaffa1b7ca3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.958146:0:9532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7c56 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d290 expref: 20 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.958154:0:9532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8aa00/0xb72beeaffa1b7ca3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.958185:0:9532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7c56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d290 expref: 20 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.958198:0:9532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7c56 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d290 expref: 20 pid: 5866 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579451.958210:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec16b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9532:1874412616887168:192.168.206.53@tcp:104: 00000100:00100000:3.0:1787579451.958282:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cd833f5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787579451.962282:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579451.962409:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591742208 00000100:00100000:0.0:1787579451.962418:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591742208 00010000:00010000:0.0:1787579451.962465:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7c56 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d290 expref: 21 pid: 5866 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579451.962509:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 84 00000100:00100000:0.0:1787579451.962519:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+21:2360:x1874412591742208:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579451.962532:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579451.962539:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7c56 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d290 expref: 21 pid: 5866 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.962557:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7c56 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d290 expref: 21 pid: 5866 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.962578:0:5851:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:0.0:1787579451.962586:0:5851:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8aa00/0xb72beeaffa1b7ca3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.962595:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8aa00/0xb72beeaffa1b7ca3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.962612:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8aa00/0xb72beeaffa1b7ca3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579451.962630:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579451.962684:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+21:2360:x1874412591742208:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 167us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579451.962702:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 84 00010000:00010000:2.0:1787579451.963212:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319600/0xb72beeaffa1b7c56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d290 expref: 20 pid: 5866 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579451.963242:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec16b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9532:1874412616887168:192.168.206.53@tcp:104: 00010000:00010000:2.0:1787579451.963262:0:9532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8aa00/0xb72beeaffa1b7ca3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.963271:0:9532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8aa00/0xb72beeaffa1b7ca3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.963277:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8aa00/0xb72beeaffa1b7ca3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787579451.963447:0:9532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1787579451.963594:0:9532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1787579451.963632:0:9532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1787579451.963706:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1ad2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9532:1874412616887296:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787579451.963752:0:9532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579451.963788:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d11d000 going to sleep for 11 seconds 00000100:00100000:3.0:1787579451.963902:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616887296 00000100:00100000:3.0:1787579451.963907:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616887296 00000100:00100000:3.0:1787579451.963967:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787579451.963975:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9532:x1874412616887296:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787579451.964038:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9532:x1874412616887296:12345-0@lo:1000:mdt00_004.0 Request processed in 64us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579451.964044:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787579451.964356:0:9532:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:2.0:1787579451.964361:0:9532:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:2.0:1787579451.964377:0:9532:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffffa0cec16b7b80 x1874412616886528/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787579467 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579451.964387:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1ad2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9532:1874412616887296:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1787579451.964852:0:9532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1787579451.964912:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1ad2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9532:1874412616887424:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787579451.965162:0:9532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579451.965265:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d11d780 going to sleep for 11 seconds 00000100:00100000:3.0:1787579451.965604:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616887424 00000100:00100000:3.0:1787579451.965612:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616887424 00000100:00100000:3.0:1787579451.965701:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787579451.965717:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9532:x1874412616887424:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787579451.965985:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:9532:x1874412616887424:12345-0@lo:1000:mdt00_004.0 Request processed in 269us (822us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1787579451.965993:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787579451.968984:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1ad2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9532:1874412616887424:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1787579451.969051:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8aa00/0xb72beeaffa1b7ca3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.969062:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8aa00/0xb72beeaffa1b7ca3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.969070:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8aa00/0xb72beeaffa1b7ca3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.969076:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8aa00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579451.969081:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8aa00/0xb72beeaffa1b7ca3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.969088:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8aa00/0xb72beeaffa1b7ca3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.969103:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0ce84d55b00) 00010000:00010000:2.0:1787579451.969107:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787579451.969111:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8aa00/0xb72beeaffa1b7ca3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.969118:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8aa00/0xb72beeaffa1b7ca3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.969153:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7be6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.969160:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7be6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.969166:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7be6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.969181:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9400 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579451.969185:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7be6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.969192:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7be6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.969202:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:2.0:1787579451.969204:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787579451.969211:0:9532:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7bed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d274 expref: 23 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.969222:0:9532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7bed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d274 expref: 23 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.969232:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7bed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d274 expref: 23 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.969268:0:9532:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7bed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d274 expref: 23 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579451.969281:0:9532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1ad3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9532:1874412616887552:192.168.206.53@tcp:105: 00000100:00100000:2.0:1787579451.969844:0:9532:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d11d780 going to sleep for 11 seconds 00000100:00100000:2.0:1787579451.976338:0:9532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1ad3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9532:1874412616887552:192.168.206.53@tcp:105: 00010000:00010000:2.0:1787579451.976365:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7be6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.976391:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7be6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.976420:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7caa lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.976432:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7caa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.976441:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7caa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.976450:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7caa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.976457:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7caa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.976463:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7caa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.976468:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318000 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579451.976471:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7caa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.976477:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7caa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.976486:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:2.0:1787579451.976489:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579451.976492:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7caa lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.976502:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7caa lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.976512:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7c9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.976517:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7c9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.976522:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7c9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.976527:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8ba00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579451.976530:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7c9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.976534:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7c9c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.976552:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:2.0:1787579451.976555:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787579451.976558:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7c9c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.976563:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ba00/0xb72beeaffa1b7c9c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579451.976803:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+23:11641:x1874412591742080:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 19003us (19211us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1787579451.976812:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 230 00000020:00080000:2.0:1787579451.976826:0:9532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787579451.978121:0:11712:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787579451.978128:0:11712:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787579451.978655:0:11712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787579451.978666:0:11712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787579451.979093:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579451.979168:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591742336 00000100:00100000:2.0:1787579451.979177:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591742336 00000100:00100000:2.0:1787579451.979226:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 61 00000100:00100000:2.0:1787579451.979235:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+23:11639:x1874412591742336:12345-192.168.206.53@tcp:49:lfs.0 00000100:00100000:2.0:1787579451.979354:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+23:11639:x1874412591742336:12345-192.168.206.53@tcp:49:lfs.0 Request processed in 120us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579451.979362:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 61 00000100:00100000:0.0:1787579451.982123:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579451.983224:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591742592 00000100:00100000:3.0:1787579451.983235:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591742592 00000100:00100000:3.0:1787579451.983292:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 231 00000100:00100000:3.0:1787579451.983301:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+23:11639:x1874412591742592:12345-192.168.206.53@tcp:58:lfs.0 00000040:00080000:3.0:1787579451.983612:0:5867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1787579451.984938:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+23:11639:x1874412591742592:12345-192.168.206.53@tcp:58:lfs.0 Request processed in 1621us (2804us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579451.984950:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 231 00000100:00100000:1.0:1787579451.989049:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579451.989193:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591742848 00000100:00100000:2.0:1787579451.989201:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591742848 00000100:00100000:2.0:1787579451.989255:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 62 00000100:00100000:2.0:1787579451.989266:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce9c707450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+23:11641:x1874412591742848:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787579451.989901:0:5869:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787579451.990047:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1787579451.990091:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7cb1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.990106:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7cb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.990118:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7cb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.990127:0:5869:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7cb1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.990133:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7cb1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.990140:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7cb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579451.990168:0:5869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787579451.990254:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce9c707450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+25:11641:x1874412591742848:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 Request processed in 989us (1218us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1787579451.990263:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 62 00000020:00080000:2.0:1787579451.990268:0:5869:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787579451.990488:0:8476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787579451.990494:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7cb1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.990501:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318000 already unused, calling callback (ffffffffc1654230) 00010000:00010000:3.0:1787579451.990510:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7cb1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.990518:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7cb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.990529:0:8476:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0cea147d700) 00010000:00010000:3.0:1787579451.990532:0:8476:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787579451.990535:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7cb1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.990541:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318000/0xb72beeaffa1b7cb1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579451.990556:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579451.990558:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579451.990560:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579452.020717:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579452.020810:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591742976 00000100:00100000:3.0:1787579452.020820:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591742976 00000100:00100000:3.0:1787579452.020877:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 232 00000100:00100000:3.0:1787579452.020887:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+25:11643:x1874412591742976:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1787579452.020910:0:9530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579452.020954:0:9530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b7cb8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d2ac expref: -99 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579452.021016:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ae00/0xb72beeaffa1b7cbf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579452.021031:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ae00/0xb72beeaffa1b7cbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579452.021041:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ae00/0xb72beeaffa1b7cbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579452.021071:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a600/0xb72beeaffa1b7cc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579452.021079:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a600/0xb72beeaffa1b7cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579452.021085:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a600/0xb72beeaffa1b7cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579452.021372:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a400/0xb72beeaffa1b7ccd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579452.021385:0:9530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7bd8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d26d expref: 26 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579452.021393:0:9530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a400/0xb72beeaffa1b7ccd lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579452.021428:0:9530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7bd8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d26d expref: 26 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579452.021442:0:9530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7bd8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d26d expref: 26 pid: 9532 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579452.021456:0:9530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec16b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9530:1874412616887680:192.168.206.53@tcp:104: 00000100:00100000:3.0:1787579452.022570:0:9530:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cd833f56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787579452.028205:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579452.028357:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591743232 00000100:00100000:2.0:1787579452.028366:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591743232 00000100:00100000:2.0:1787579452.028424:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 63 00000100:00100000:2.0:1787579452.028433:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+27:5601:x1874412591743232:12345-192.168.206.53@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787579452.028650:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+28:5601:x1874412591743232:12345-192.168.206.53@tcp:35:ldlm_bl.0 Request processed in 218us (455us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1787579452.028659:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 63 00000100:00100000:3.0:1787579452.031035:0:9530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec16b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9530:1874412616887680:192.168.206.53@tcp:104: 00010000:00010000:3.0:1787579452.031062:0:9530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a400/0xb72beeaffa1b7ccd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579452.031338:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579452.031407:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591743360 00000100:00100000:0.0:1787579452.031414:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591743360 00010000:00010000:0.0:1787579452.031445:0:5850:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7bd8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d26d expref: 28 pid: 9532 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579452.031479:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 85 00000100:00100000:0.0:1787579452.031488:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+28:2359:x1874412591743360:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579452.031501:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579452.031508:0:5850:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7bd8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d26d expref: 28 pid: 9532 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579452.031519:0:5850:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7bd8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d26d expref: 28 pid: 9532 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579452.031604:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b7bd8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d26d expref: 28 pid: 9532 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579452.031622:0:5850:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:0.0:1787579452.031627:0:5850:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a400/0xb72beeaffa1b7ccd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579452.031646:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a400/0xb72beeaffa1b7ccd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579452.031653:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a400/0xb72beeaffa1b7ccd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579452.031684:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579452.031757:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:963d8c17-1326-491b-be60-9002b9296555+27:2359:x1874412591743360:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 253us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579452.031765:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 85 00010000:00010000:1.0:1787579452.032005:0:9530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a400/0xb72beeaffa1b7ccd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579452.032013:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a400/0xb72beeaffa1b7ccd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787579452.032051:0:9530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787579452.032055:0:9530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787579452.032080:0:9530:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a400/0xb72beeaffa1b7ccd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579452.032092:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a400/0xb72beeaffa1b7ccd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579452.032101:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ae00/0xb72beeaffa1b7cbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579452.032107:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ae00/0xb72beeaffa1b7cbf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579452.032113:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ae00/0xb72beeaffa1b7cbf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579452.032118:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8ae00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579452.032122:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ae00/0xb72beeaffa1b7cbf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579452.032129:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ae00/0xb72beeaffa1b7cbf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579452.032138:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:1.0:1787579452.032141:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579452.032145:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ae00/0xb72beeaffa1b7cbf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579452.032151:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8ae00/0xb72beeaffa1b7cbf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579452.032162:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a600/0xb72beeaffa1b7cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579452.032168:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a600/0xb72beeaffa1b7cc6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579452.032179:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a600/0xb72beeaffa1b7cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579452.032184:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8a600 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579452.032187:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a600/0xb72beeaffa1b7cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579452.032192:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a600/0xb72beeaffa1b7cc6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579452.032199:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0ce988a2400) 00010000:00010000:1.0:1787579452.032201:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579452.032204:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a600/0xb72beeaffa1b7cc6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579452.032210:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a600/0xb72beeaffa1b7cc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579452.032245:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b7cb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2ac expref: 27 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579452.032258:0:9530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a400/0xb72beeaffa1b7ccd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2ac expref: 26 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579452.032266:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:1.0:1787579452.032268:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787579452.032270:0:9530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce90a8a400, rc 0) 00000100:00100000:1.0:1787579452.032300:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+26:11643:x1874412591742976:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 11415us (11593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579452.032315:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 232 00000040:00080000:2.0:1787579452.754567:0:12641:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787579452.754575:0:12641:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787579452.754636:0:12641:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787579452.754642:0:12641:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787579452.839748:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787579452.950700:0:6735:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1787579452.950723:0:6735:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000040:00080000:0.0:1787579453.031660:0:11712:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787579453.031736:0:11712:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787579453.031803:0:11712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787579453.031809:0:11712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787579453.032317:0:11712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11712:1874412616887808:192.168.206.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787579453.032440:0:11712:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce865e9840 going to sleep for 11 seconds 00000100:00100000:0.0:1787579453.036439:0:11712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11712:1874412616887808:192.168.206.53@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787579453.047150:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579453.047370:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591743488 00000100:00100000:2.0:1787579453.047379:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591743488 00000100:00100000:2.0:1787579453.047443:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 233 00000100:00100000:2.0:1787579453.047453:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec16b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+26:11655:x1874412591743488:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787579453.047484:0:9532:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787579453.047578:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec16b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+26:11655:x1874412591743488:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 Request processed in 126us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579453.047586:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 233 00000100:00080000:1.0:1787579453.047667:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579453.054500:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579453.054807:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591743744 00000100:00100000:3.0:1787579453.054815:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591743744 00000100:00100000:3.0:1787579453.054875:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 234 00000100:00100000:3.0:1787579453.054886:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+26:11655:x1874412591743744:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787579453.054905:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579453.054946:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b600/0xb72beeaffa1b7cd4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d2b3 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579453.055046:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b7cdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579453.055061:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b7cdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579453.055072:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b7cdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579453.055083:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787579453.055429:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b600/0xb72beeaffa1b7cd4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2b3 expref: 29 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579453.055447:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b7cdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2b3 expref: 28 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579453.055457:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:3.0:1787579453.055460:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787579453.055477:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce90a8b200, rc 0) 00000100:00100000:3.0:1787579453.055541:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+28:11655:x1874412591743744:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 657us (1050us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1787579453.055549:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 234 00000100:00100000:0.0:1787579453.064562:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579453.064641:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591744000 00000100:00100000:0.0:1787579453.064648:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579453.064650:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591744000 00000100:00100000:1.0:1787579453.064714:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 235 00000100:00100000:2.0:1787579453.064719:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591744128 00000100:00100000:1.0:1787579453.064725:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+28:11655:x1874412591744000:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787579453.064734:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591744128 00000100:00100000:2.0:1787579453.064783:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 17 00000100:00100000:2.0:1787579453.064790:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+29:2359:x1874412591744128:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787579453.064800:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787579453.064804:0:9530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7ce9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579453.064817:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b200/0xb72beeaffa1b7cdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2b3 expref: 29 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579453.064820:0:9530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7ce9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579453.064829:0:9530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7ce9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579453.064832:0:5851:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:2.0:1787579453.064836:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579453.064885:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:963d8c17-1326-491b-be60-9002b9296555+28:2359:x1874412591744128:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 95us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579453.064892:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 17 00010000:00010000:1.0:1787579453.065042:0:9530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7ce9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579453.065051:0:9530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7ce9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579453.065057:0:9530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7ce9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579453.065063:0:9530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c9400 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579453.065067:0:9530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7ce9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579453.065074:0:9530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7ce9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579453.065092:0:9530:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:1.0:1787579453.065094:0:9530:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787579453.065098:0:9530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7ce9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579453.065104:0:9530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9400/0xb72beeaffa1b7ce9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579453.066238:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+28:11655:x1874412591744000:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 1507us (1677us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1787579453.066249:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 235 00000100:00100000:0.0:1787579453.072636:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579453.072716:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591744384 00000100:00100000:2.0:1787579453.072726:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591744384 00000100:00100000:2.0:1787579453.072787:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 64 00000100:00100000:2.0:1787579453.072797:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+28:11655:x1874412591744384:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787579453.073054:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+29:11655:x1874412591744384:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 Request processed in 257us (426us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1787579453.073062:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 64 00000040:00080000:1.0:1787579453.075293:0:11712:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787579453.075301:0:11712:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787579453.075823:0:11712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787579453.075833:0:11712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787579453.857535:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787579454.619316:0:12696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787579454.619327:0:12696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787579454.619377:0:12696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787579454.619386:0:12696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787579454.793483:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579454.793751:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591744640 00000100:00100000:3.0:1787579454.793771:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591744640 00000100:00100000:3.0:1787579454.793829:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 236 00000100:00100000:3.0:1787579454.793838:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+29:11675:x1874412591744640:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1787579454.793860:0:9532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579454.793879:0:9532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b600/0xb72beeaffa1b7cf0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d2ba expref: -99 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579454.794012:0:9532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a600/0xb72beeaffa1b7cf7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579454.794026:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a600/0xb72beeaffa1b7cf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579454.794036:0:9532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a600/0xb72beeaffa1b7cf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579454.794048:0:9532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787579454.794168:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8b600/0xb72beeaffa1b7cf0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2ba expref: 32 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579454.794184:0:9532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a600/0xb72beeaffa1b7cf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2ba expref: 31 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579454.794193:0:9532:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:3.0:1787579454.795158:0:9532:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787579454.795163:0:9532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce90a8a600, rc 0) 00000100:00100000:3.0:1787579454.795426:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+31:11675:x1874412591744640:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 1586us (1949us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1787579454.795435:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 236 00000100:00100000:3.0:1787579454.805484:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579454.805556:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591744768 00000100:00100000:0.0:1787579454.805567:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591744768 00000100:00100000:0.0:1787579454.805626:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 237 00000100:00100000:0.0:1787579454.805637:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+31:11675:x1874412591744768:12345-192.168.206.53@tcp:54:lfs.0 00010000:00010000:0.0:1787579454.805704:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7d05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579454.805734:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7d05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579454.805744:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7d05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579454.805781:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7d05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579454.805789:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7d05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579454.805796:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7d05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579454.805801:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579454.805805:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7d05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579454.805812:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7d05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579454.805824:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:0.0:1787579454.805826:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787579454.805831:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7d05 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579454.805837:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b7d05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579454.805922:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:963d8c17-1326-491b-be60-9002b9296555+31:11675:x1874412591744768:12345-192.168.206.53@tcp:54:lfs.0 Request processed in 286us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579454.805975:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 237 00010000:00010000:3.0:1787579454.880669:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579454.929878:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579454.930077:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591744896 00000100:00100000:3.0:1787579454.930087:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591744896 00000100:00100000:3.0:1787579454.930214:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 72 00000100:00100000:3.0:1787579454.930233:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+7:2359:x1874412591744896:12345-192.168.206.53@tcp:101:cat.0 00010000:00010000:3.0:1787579454.930250:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579454.930268:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000245d339/0xb72beeaffa1b7d0c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d2c1 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787579454.930295:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8c4c39, atime: 0x6a8c4c39, ctime: 0x6a8c4c39, blocks: 0xb 00010000:00010000:3.0:1787579454.930314:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=391s v=(0 0) 00010000:00010000:3.0:1787579454.930319:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579454.930328:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000245d339/0xb72beeaffa1b7d0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2c1 expref: 8 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579454.930345:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000245d339/0xb72beeaffa1b7d0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2c1 expref: 8 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579454.930358:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce90a8b600, rc 0) 00000100:00100000:3.0:1787579454.930421:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+8:2359:x1874412591744896:12345-192.168.206.53@tcp:101:cat.0 Request processed in 190us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579454.930442:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 72 00000100:00080000:1.0:1787579454.931650:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787579454.935507:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579454.935684:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591745024 00000100:00100000:1.0:1787579454.935752:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591745024 00002000:00100000:1.0:1787579454.935809:0:6715:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffffa0cebab69c00 x1874412591745024/t0(0) o3->963d8c17-1326-491b-be60-9002b9296555@192.168.206.53@tcp:695/0 lens 488/0 e 0 to 0 dl 1787579465 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787579454.935820:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0cebab69c00 with x1874412591745024 ext(0->4095) 00002000:00010000:1.0:1787579454.935825:0:6715:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0cebab69c00 00000100:00100000:1.0:1787579454.935855:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:1.0:1787579454.935877:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:963d8c17-1326-491b-be60-9002b9296555+8:2360:x1874412591745024:12345-192.168.206.53@tcp:3:cat.0 00000100:00100000:1.0:1787579454.936269:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:963d8c17-1326-491b-be60-9002b9296555+8:2360:x1874412591745024:12345-192.168.206.53@tcp:3:cat.0 Request processed in 391us (768us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787579454.936277:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 8 00002000:00100000:1.0:1787579454.936285:0:6715:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffffa0cebab69c00 x1874412591745024/t0(0) o3->963d8c17-1326-491b-be60-9002b9296555@192.168.206.53@tcp:695/0 lens 488/4536 e 0 to 0 dl 1787579465 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787579454.936294:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0cebab69c00 with x1874412591745024 ext(0->4095) 00002000:00010000:1.0:1787579454.936297:0:6715:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0cebab69c00 00010000:00010000:3.0:1787579455.904246:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579456.179076:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579456.179111:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579456.179145:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579456.179164:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579456.179191:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579456.179219:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591745280 00000100:00100000:1.0:1787579456.179228:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591745280 00000100:00100000:1.0:1787579456.179282:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591745664 00000100:00100000:1.0:1787579456.179285:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591745664 00000100:00100000:1.0:1787579456.179308:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 151 00000100:00100000:1.0:1787579456.179318:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+31:2361:x1874412591745280:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579456.179389:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+31:2361:x1874412591745280:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 72us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579456.179397:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 151 00000100:00100000:1.0:1787579456.179414:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 152 00000100:00100000:1.0:1787579456.179422:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2361:x1874412591745664:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579456.179448:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2361:x1874412591745664:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 27us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579456.179462:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 152 00000100:00100000:1.0:1787579456.179482:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591745536 00000100:00100000:1.0:1787579456.179486:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591745536 00000100:00100000:1.0:1787579456.179511:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591745408 00000100:00100000:1.0:1787579456.179513:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591745408 00000100:00100000:1.0:1787579456.179531:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 72 00000100:00100000:1.0:1787579456.179537:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+8:2361:x1874412591745536:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579456.179563:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+8:2361:x1874412591745536:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 27us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579456.179570:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 72 00000100:00100000:1.0:1787579456.179581:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 73 00000100:00100000:1.0:1787579456.179588:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce87acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+5:2361:x1874412591745408:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579456.179611:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce87acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:963d8c17-1326-491b-be60-9002b9296555+5:2361:x1874412591745408:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 23us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579456.179616:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 73 00000100:00100000:1.0:1787579456.179632:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591745152 00000100:00100000:1.0:1787579456.179634:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591745152 00000100:00100000:1.0:1787579456.179656:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 295 00000100:00100000:1.0:1787579456.179662:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+13:2361:x1874412591745152:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579456.179682:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:803d6039-c137-4d52-85de-c5895e5f2411+13:2361:x1874412591745152:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 21us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579456.179687:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 295 00000100:00080000:1.0:1787579456.179714:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787579456.179718:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787579456.179720:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787579456.484649:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1ad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616888064:0@lo:400:kworker.0 00000100:00100000:2.0:1787579456.484709:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579456.484808:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1ad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616888320:0@lo:400:kworker.0 00000100:00100000:0.0:1787579456.484846:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579456.484895:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787579456.484902:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616887936:0@lo:400:kworker.0 00000100:00100000:0.0:1787579456.484949:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579456.484969:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3322:1874412616888192:0@lo:400:kworker.0 00000100:00100000:0.0:1787579456.484978:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616888448:0@lo:400:kworker.0 00000100:00100000:0.0:1787579456.485016:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579456.485047:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616888320 00000100:00100000:0.0:1787579456.485053:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616888320 00000100:00100000:0.0:1787579456.485107:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616888448 00000100:00100000:0.0:1787579456.485110:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616888448 00000100:00100000:0.0:1787579456.485132:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787579456.485141:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba18cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616888320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579456.485189:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba18cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616888320:12345-0@lo:400:kworker.0 Request processed in 49us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579456.485195:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787579456.485316:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787579456.485323:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3319:x1874412616888448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579456.485363:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3319:x1874412616888448:12345-0@lo:400:kworker.0 Request processed in 40us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579456.485369:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787579456.485388:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616887936 00000100:00100000:0.0:1787579456.485391:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616887936 00000100:00100000:0.0:1787579456.485414:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1787579456.485431:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3319:x1874412616887936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579456.485462:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3319:x1874412616887936:12345-0@lo:400:kworker.0 Request processed in 33us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579456.485468:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1787579456.485530:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616887936:0@lo:400:kworker.0 00000100:00100000:0.0:1787579456.485545:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616888448:0@lo:400:kworker.0 00000100:00100000:0.0:1787579456.485552:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787579456.485557:0:3319:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1787579456.485572:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0cec16b5880, transno 4294967310 00000100:00100000:0.0:1787579456.485581:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1ad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616888320:0@lo:400:kworker.0 00000100:00080000:3.0:1787579456.487293:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787579456.487302:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787579456.487662:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579456.487852:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616888064 00000100:00100000:2.0:1787579456.487860:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616888064 00000100:00100000:2.0:1787579456.487906:0:9530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616888192 00000100:00100000:2.0:1787579456.487910:0:9530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616888192 00000100:00100000:2.0:1787579456.487962:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787579456.487982:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1ad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616888064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579456.488055:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1ad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616888064:12345-0@lo:400:kworker.0 Request processed in 75us (3346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579456.488062:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787579456.488078:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787579456.488084:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1874412616888192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579456.488111:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1874412616888192:12345-0@lo:400:kworker.0 Request processed in 28us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579456.488117:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1787579456.488316:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787579456.488345:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3322:1874412616888192:0@lo:400:kworker.0 00000100:00100000:0.0:1787579456.488470:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1ad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616888064:0@lo:400:kworker.0 00000100:00100000:0.0:1787579456.488480:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1874412616888576:0@lo:400:kworker.0 00000100:00100000:0.0:1787579456.488513:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579456.488587:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616888576 00000100:00100000:3.0:1787579456.488592:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616888576 00000100:00100000:3.0:1787579456.488637:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787579456.488644:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874412616888576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579456.488683:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874412616888576:12345-0@lo:400:kworker.0 Request processed in 39us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579456.488690:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787579456.488716:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1874412616888576:0@lo:400:kworker.0 00000100:00080000:0.0:1787579456.488796:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1787579456.489416:0:7659:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 392680488674ns, next at 393680486015ns, rc = 0 00000100:00100000:2.0:1787579456.489461:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787579456.489472:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616888704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787579456.489507:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579456.489568:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616888704 00000100:00100000:3.0:1787579456.489573:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616888704 00000100:00100000:3.0:1787579456.489610:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787579456.489617:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1874412616888704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787579456.489642:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787579456.489681:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1874412616888704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579456.489701:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787579456.489735:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616888704:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787579456.928188:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579456.992334:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787579456.992355:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebfa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616888832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787579456.992417:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579456.992487:0:7952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616888832 00000100:00100000:1.0:1787579456.992494:0:7952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616888832 00000100:00100000:1.0:1787579456.992546:0:7952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787579456.992554:0:7952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616888832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787579456.992585:0:7952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787579456.992623:0:7952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616888832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579456.992629:0:7952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787579456.992670:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebfa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616888832:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1787579457.034122:0:5888:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000001:00080000:3.0:1787579457.034134:0:5888:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:3.0:1787579457.034148:0:5888:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0ce9d11d000 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1787579457.034153:0:5888:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0cec1592700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0ce9d11d900 00000020:00080000:3.0:1787579457.034157:0:5888:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0cec1592e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0ceb4475400 00000004:00080000:3.0:1787579457.034182:0:5888:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000001:00080000:3.0:1787579457.034195:0:5888:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1787579457.034205:0:5888:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000100:00100000:3.0:1787579457.034271:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616888960:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787579457.034334:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579457.034407:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616888960 00000100:00100000:3.0:1787579457.034413:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616888960 00000100:00100000:3.0:1787579457.034453:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787579457.034463:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3320:x1874412616888960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787579457.034676:0:6712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787579457.034680:0:6712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787579449 -> 1787579449 00002000:00010000:3.0:1787579457.034682:0:6712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1787579449 -> 1787579449 00002000:00010000:3.0:1787579457.034685:0:6712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787579449 -> 1787579449 00002000:00010000:3.0:1787579457.034687:0:6712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1787579457.034725:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3320:x1874412616888960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 263us (390us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1787579457.034732:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:3.0:1787579457.034798:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0cebab6aa00/2, rc 0, transno 4294967325 00000100:00100000:3.0:1787579457.034804:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616888960:0@lo:2:osp-syn-1-0.0 00000020:00080000:2.0:1787579457.035026:0:5899:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1787579457.035182:0:5899:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:1.0:1787579457.037480:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1787579457.037494:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000040:00080000:1.0:1787579457.184143:0:11712:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787579457.184151:0:11712:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787579457.184181:0:11712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787579457.184188:0:11712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787579457.952145:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579458.979025:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579459.981252:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579459.981546:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591745792 00000100:00100000:2.0:1787579459.981555:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591745792 00000100:00080000:0.0:1787579459.981607:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787579459.981630:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 238 00000100:00100000:2.0:1787579459.981643:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+18:11320:x1874412591745792:12345-192.168.206.53@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787579459.981748:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:963d8c17-1326-491b-be60-9002b9296555+18:11320:x1874412591745792:12345-192.168.206.53@tcp:60:lhsmtool_posix.0 Request processed in 108us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579459.981756:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 238 00000100:00100000:1.0:1787579459.986594:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579459.986773:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591746048 00000100:00100000:0.0:1787579459.986783:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591746048 00000100:00100000:0.0:1787579459.986844:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 65 00000100:00100000:0.0:1787579459.986856:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+18:11320:x1874412591746048:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787579459.987559:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+19:11320:x1874412591746048:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 Request processed in 646us (913us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1787579459.987568:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 65 00010000:00010000:3.0:1787579460.003706:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579460.241310:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579460.241439:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591746176 00000100:00100000:0.0:1787579460.241454:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591746176 00000100:00100000:0.0:1787579460.241546:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 239 00000100:00100000:0.0:1787579460.241557:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:12126:x1874412591746176:12345-192.168.206.53@tcp:101:lsof.0 00010000:00010000:0.0:1787579460.241621:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579460.241643:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7d13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d2c8 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579460.241712:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7d1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579460.241738:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7d1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579460.241749:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7d1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579460.241919:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787579460.241959:0:5867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787579460.242046:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7d1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579460.242070:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b7d13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2c8 expref: 7 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579460.242089:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7d1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2c8 expref: 6 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579460.242098:0:5867:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce82cbb500) 00010000:00010000:0.0:1787579460.242102:0:5867:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787579460.242105:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c9400, rc 0) 00000100:00080000:3.0:1787579460.242109:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579460.242223:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10f8d08d-5315-46af-9d52-63a85ea5c0aa+6:12126:x1874412591746176:12345-192.168.206.53@tcp:101:lsof.0 Request processed in 668us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579460.242237:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 239 00010000:00010000:3.0:1787579461.024130:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579461.297895:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579461.297961:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579461.297999:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579461.298029:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579461.298057:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579461.298082:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591746816 00000100:00100000:1.0:1787579461.298102:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591746816 00000100:00100000:1.0:1787579461.298145:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591746432 00000100:00100000:1.0:1787579461.298148:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591746432 00000100:00100000:1.0:1787579461.298179:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 156 00000100:00100000:1.0:1787579461.298200:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10f8d08d-5315-46af-9d52-63a85ea5c0aa+6:2361:x1874412591746816:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579461.298269:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10f8d08d-5315-46af-9d52-63a85ea5c0aa+6:2361:x1874412591746816:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 71us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579461.298277:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 156 00000100:00100000:1.0:1787579461.298294:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 157 00000100:00100000:1.0:1787579461.298300:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+19:2361:x1874412591746432:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579461.298331:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+19:2361:x1874412591746432:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 32us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579461.298350:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 157 00000100:00080000:1.0:1787579461.298368:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579461.298523:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591746560 00000100:00100000:0.0:1787579461.298528:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591746560 00000100:00100000:0.0:1787579461.298567:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591746688 00000100:00100000:0.0:1787579461.298570:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591746688 00000100:00100000:0.0:1787579461.298588:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 76 00000100:00100000:0.0:1787579461.298595:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+5:2361:x1874412591746560:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579461.298625:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+5:2361:x1874412591746560:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 31us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579461.298632:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 76 00000100:00100000:0.0:1787579461.298643:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 77 00000100:00100000:0.0:1787579461.298649:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec17c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+7:2361:x1874412591746688:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579461.298670:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec17c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:963d8c17-1326-491b-be60-9002b9296555+7:2361:x1874412591746688:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 21us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579461.298675:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 77 00000100:00080000:1.0:1787579461.300264:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787579461.300271:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787579461.300407:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591746304 00000100:00100000:3.0:1787579461.300415:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591746304 00000100:00100000:3.0:1787579461.300466:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 297 00000100:00100000:3.0:1787579461.300474:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+13:2361:x1874412591746304:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1787579461.300533:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+13:2361:x1874412591746304:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 60us (2646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579461.300540:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 297 00000100:00100000:2.0:1787579461.600163:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616889344:0@lo:400:kworker.0 00000100:00100000:1.0:1787579461.600163:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616889216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787579461.600237:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1ad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616889088:0@lo:400:kworker.0 00000100:00100000:3.0:1787579461.601458:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1ad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1874412616889472:0@lo:400:kworker.0 00000100:00100000:2.0:1787579461.604164:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579461.604240:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579461.604253:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1ad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1874412616889856:0@lo:400:kworker.0 00000100:00100000:2.0:1787579461.604342:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616889344 00000100:00100000:2.0:1787579461.604349:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616889344 00000100:00100000:3.0:1787579461.604381:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616889472 00000100:00100000:3.0:1787579461.604386:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616889472 00000100:00100000:2.0:1787579461.604397:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787579461.604409:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616889344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579461.604432:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787579461.604442:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874412616889472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579461.604461:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616889344:12345-0@lo:400:kworker.0 Request processed in 54us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579461.604469:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787579461.604612:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874412616889472:12345-0@lo:400:kworker.0 Request processed in 173us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579461.604620:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787579461.604659:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1ad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1874412616889472:0@lo:400:kworker.0 00000100:00080000:3.0:1787579461.604690:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579461.605172:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579461.605205:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616889728:0@lo:400:kworker.0 00000100:00100000:1.0:1787579461.605233:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579461.605345:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616889216 00000100:00100000:1.0:1787579461.605350:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616889216 00000100:00100000:1.0:1787579461.605424:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787579461.605430:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec17c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3322:x1874412616889216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787579461.605457:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787579461.605601:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec17c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3322:x1874412616889216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 169us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579461.605616:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787579461.605658:0:3322:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1787579461.605664:0:3322:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0cec16b7b80, transno 4294967322 00000004:00080000:1.0:1787579461.605674:0:3322:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1787579461.605691:0:3322:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffffa0cebab6aa00 x1874412616888960/t4294967325(4294967325) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787579473 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579461.605704:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616889216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787579461.605750:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616889728 00000100:00100000:1.0:1787579461.605754:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616889728 00000100:00100000:1.0:1787579461.605778:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787579461.605784:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec17c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3322:x1874412616889728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579461.605816:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec17c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3322:x1874412616889728:12345-0@lo:400:kworker.0 Request processed in 32us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579461.605821:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787579461.605855:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616889728:0@lo:400:kworker.0 00000100:00100000:2.0:1787579461.606050:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579461.606095:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616889344:0@lo:400:kworker.0 00000100:00100000:2.0:1787579461.606116:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616889856 00000100:00100000:2.0:1787579461.606120:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616889856 00000100:00100000:0.0:1787579461.606640:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579461.606740:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616889600:0@lo:400:kworker.0 00000100:00100000:0.0:1787579461.606772:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579461.606816:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616889600 00000100:00100000:0.0:1787579461.606822:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616889600 00000100:00100000:0.0:1787579461.606855:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787579461.606863:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616889600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579461.606912:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616889600:12345-0@lo:400:kworker.0 Request processed in 50us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579461.606941:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787579461.606981:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616889600:0@lo:400:kworker.0 00000100:00080000:3.0:1787579461.606994:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787579461.606999:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787579461.607001:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787579461.607150:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616889088 00000100:00100000:1.0:1787579461.607155:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616889088 00000100:00100000:1.0:1787579461.607185:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1787579461.607194:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3321:x1874412616889088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579461.607288:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3321:x1874412616889088:12345-0@lo:400:kworker.0 Request processed in 96us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579461.607295:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1787579461.607417:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1ad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616889088:0@lo:400:kworker.0 00000100:00100000:2.0:1787579461.609130:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787579461.609141:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874412616889856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579461.609488:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874412616889856:12345-0@lo:400:kworker.0 Request processed in 348us (3437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579461.609565:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787579461.611024:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1ad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1874412616889856:0@lo:400:kworker.0 00010000:00010000:2.0:1787579462.049609:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579462.112996:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787579462.113020:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616889984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787579462.113087:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579462.113189:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616889984 00000100:00100000:2.0:1787579462.113197:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616889984 00000100:00100000:2.0:1787579462.113242:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787579462.113252:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616889984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787579462.113285:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579462.113331:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616889984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579462.113347:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787579462.113588:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616889984:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1787579462.163832:0:5888:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1787579462.163856:0:5888:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1787579462.163893:0:5899:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1787579462.163902:0:5899:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:0.0:1787579462.169193:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:02000400:0.0:1787579462.425452:0:12897:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 09:51:00 (1787579460) 00010000:00010000:1.0:1787579463.073103:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579464.104179:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579465.120166:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579466.145447:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579466.434678:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579466.434732:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579466.434792:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579466.434822:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579466.434844:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579466.434874:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591747200 00000100:00100000:1.0:1787579466.434882:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591747200 00000100:00100000:1.0:1787579466.434961:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591747328 00000100:00100000:1.0:1787579466.434965:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591747328 00000100:00100000:1.0:1787579466.434990:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 80 00000100:00100000:1.0:1787579466.435000:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec17c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+5:2362:x1874412591747200:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579466.435066:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec17c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+5:2362:x1874412591747200:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 68us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579466.435074:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 80 00000100:00100000:1.0:1787579466.435090:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 81 00000100:00100000:1.0:1787579466.435097:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+7:2361:x1874412591747328:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579466.435123:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+7:2361:x1874412591747328:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 27us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579466.435129:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 81 00000100:00100000:0.0:1787579466.435566:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591746944 00000100:00100000:0.0:1787579466.435572:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591746944 00000100:00100000:0.0:1787579466.435606:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 299 00000100:00100000:0.0:1787579466.435613:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+13:2362:x1874412591746944:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579466.435641:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:803d6039-c137-4d52-85de-c5895e5f2411+13:2362:x1874412591746944:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 29us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579466.435647:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 299 00000100:00100000:0.0:1787579466.435688:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591747456 00000100:00100000:0.0:1787579466.435703:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591747456 00000100:00100000:0.0:1787579466.435732:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591747072 00000100:00100000:0.0:1787579466.435735:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591747072 00000100:00100000:0.0:1787579466.435757:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 161 00000100:00100000:0.0:1787579466.435764:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10f8d08d-5315-46af-9d52-63a85ea5c0aa+6:2362:x1874412591747456:12345-192.168.206.53@tcp:400:kworker.0 00000100:00080000:2.0:1787579466.435786:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787579466.435793:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787579466.435798:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787579466.435799:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10f8d08d-5315-46af-9d52-63a85ea5c0aa+6:2362:x1874412591747456:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 33us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579466.435808:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 161 00000100:00100000:2.0:1787579466.435826:0:9530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 162 00000100:00100000:2.0:1787579466.435838:0:9530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+18:2361:x1874412591747072:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1787579466.435872:0:9530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:963d8c17-1326-491b-be60-9002b9296555+18:2361:x1874412591747072:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 37us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579466.443853:0:9530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 162 00000100:00100000:0.0:1787579466.720165:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616890112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787579466.720225:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec14b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616890240:0@lo:400:kworker.0 00000100:00100000:0.0:1787579466.720254:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579466.722708:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec14b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1874412616890496:0@lo:400:kworker.0 00000100:00100000:2.0:1787579466.722746:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec14b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616890368:0@lo:400:kworker.0 00000100:00100000:1.0:1787579466.722795:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579466.722833:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec14b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616890624:0@lo:400:kworker.0 00000100:00100000:1.0:1787579466.722843:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebf836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616890752:0@lo:400:kworker.0 00000100:00100000:1.0:1787579466.723219:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579466.723318:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616890240 00000100:00100000:1.0:1787579466.723324:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616890240 00000100:00100000:1.0:1787579466.723363:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1787579466.723372:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3322:x1874412616890240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579466.723493:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3322:x1874412616890240:12345-0@lo:400:kworker.0 Request processed in 121us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579466.723512:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1787579466.723545:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616890752 00000100:00100000:1.0:1787579466.723550:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616890752 00000100:00100000:1.0:1787579466.723583:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787579466.723589:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616890752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579466.723621:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616890752:12345-0@lo:400:kworker.0 Request processed in 33us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579466.723627:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1787579466.723644:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787579466.723666:0:3322:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1787579466.723671:0:3322:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0cebab6aa00, transno 4294967325 00000100:00100000:1.0:1787579466.723681:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebf836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616890752:0@lo:400:kworker.0 00000100:00100000:1.0:1787579466.723705:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec14b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616890240:0@lo:400:kworker.0 00000100:00100000:0.0:1787579466.724663:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579466.724682:0:7952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616890112 00000100:00100000:1.0:1787579466.724698:0:7952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616890112 00000100:00100000:0.0:1787579466.724736:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616890624 00000100:00100000:1.0:1787579466.724737:0:7952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787579466.724743:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616890624 00000100:00100000:1.0:1787579466.724749:0:7952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616890112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787579466.724777:0:7952:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579466.724782:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787579466.724790:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616890624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579466.724842:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616890624:12345-0@lo:400:kworker.0 Request processed in 53us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579466.724851:0:7952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616890112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (4597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579466.724851:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787579466.724862:0:7952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1787579466.724875:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787579466.724902:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec14b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616890624:0@lo:400:kworker.0 00000100:00100000:0.0:1787579466.724920:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616890112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787579466.727889:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579466.727981:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616890496 00000100:00100000:0.0:1787579466.727990:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616890496 00000100:00100000:0.0:1787579466.728054:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787579466.728063:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874412616890496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579466.728114:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874412616890496:12345-0@lo:400:kworker.0 Request processed in 52us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579466.728120:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:1.0:1787579466.728184:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787579466.728266:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec14b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1874412616890496:0@lo:400:kworker.0 00000100:00100000:2.0:1787579466.728634:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579466.728714:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebf835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1874412616890880:0@lo:400:kworker.0 00000100:00100000:2.0:1787579466.728742:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579466.728877:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616890368 00000100:00100000:0.0:1787579466.728882:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616890368 00000100:00100000:0.0:1787579466.728921:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616890880 00000100:00100000:0.0:1787579466.728953:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616890880 00000100:00100000:0.0:1787579466.728991:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787579466.728997:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616890368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579466.729049:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616890368:12345-0@lo:400:kworker.0 Request processed in 52us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579466.729056:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787579466.729068:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787579466.729074:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874412616890880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579466.729102:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874412616890880:12345-0@lo:400:kworker.0 Request processed in 28us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579466.729107:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:1.0:1787579466.729500:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787579466.729681:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec14b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616890368:0@lo:400:kworker.0 00000100:00100000:2.0:1787579466.729703:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebf835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3319:1874412616890880:0@lo:400:kworker.0 00000100:00100000:1.0:1787579466.822290:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579466.822385:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591747712 00000100:00100000:2.0:1787579466.822395:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591747712 00000100:00100000:2.0:1787579466.822453:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 66 00000100:00100000:2.0:1787579466.822463:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+18:12347:x1874412591747712:12345-192.168.206.53@tcp:35:umount.0 00000100:00100000:2.0:1787579466.823052:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+19:12347:x1874412591747712:12345-192.168.206.53@tcp:35:umount.0 Request processed in 587us (769us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1787579466.823069:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 66 00000100:00100000:1.0:1787579466.827096:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579466.827292:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591747968 00000100:00100000:2.0:1787579466.827301:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591747968 00000100:00100000:2.0:1787579466.827786:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 67 00000100:00100000:2.0:1787579466.827798:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+19:12347:x1874412591747968:12345-192.168.206.53@tcp:35:umount.0 00000100:00100000:2.0:1787579466.828386:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:963d8c17-1326-491b-be60-9002b9296555+20:12347:x1874412591747968:12345-192.168.206.53@tcp:35:umount.0 Request processed in 588us (1297us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1787579466.828395:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 67 00000100:00100000:1.0:1787579466.835180:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579466.835293:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591748224 00000100:00100000:0.0:1787579466.835304:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591748224 00000100:00100000:0.0:1787579466.835359:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 68 00000100:00100000:0.0:1787579466.835369:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce9c705c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+20:12347:x1874412591748224:12345-192.168.206.53@tcp:35:umount.0 00000100:00100000:0.0:1787579466.835841:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce9c705c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+21:12347:x1874412591748224:12345-192.168.206.53@tcp:35:umount.0 Request processed in 471us (668us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1787579466.835850:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 68 00000100:00100000:1.0:1787579466.839969:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579466.840239:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591748480 00000100:00100000:0.0:1787579466.840250:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591748480 00000100:00100000:0.0:1787579466.840300:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 69 00000100:00100000:0.0:1787579466.840312:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+21:12347:x1874412591748480:12345-192.168.206.53@tcp:35:umount.0 00000100:00100000:0.0:1787579466.840626:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:963d8c17-1326-491b-be60-9002b9296555+22:12347:x1874412591748480:12345-192.168.206.53@tcp:35:umount.0 Request processed in 315us (666us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1787579466.840634:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 69 00000100:00100000:1.0:1787579466.846419:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579466.846460:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579466.846581:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591748608 00000100:00100000:2.0:1787579466.846591:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591748608 00000100:00100000:2.0:1787579466.846657:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591748736 00000100:00100000:2.0:1787579466.846660:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591748736 00000100:00100000:2.0:1787579466.846700:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 18 00000100:00100000:2.0:1787579466.846709:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce831d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:803d6039-c137-4d52-85de-c5895e5f2411+14:2361:x1874412591748608:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787579466.846722:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579466.846741:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ceb3f78800/0xb72beeaffa1b6d92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce53 expref: 14 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579466.846755:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579466.846801:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce831d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:803d6039-c137-4d52-85de-c5895e5f2411+13:2361:x1874412591748608:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 93us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579466.846808:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 18 00000100:00100000:2.0:1787579466.846844:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 19 00000100:00100000:2.0:1787579466.846849:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:803d6039-c137-4d52-85de-c5895e5f2411+12:2361:x1874412591748736:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787579466.846856:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579466.846875:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce813fc000/0xb72beeaffa1b6cf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce1b expref: 12 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579466.846884:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579466.846903:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:803d6039-c137-4d52-85de-c5895e5f2411+11:2361:x1874412591748736:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 53us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579466.846920:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 19 00000100:00100000:1.0:1787579466.853826:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579466.853873:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579466.853963:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591749248 00000100:00100000:0.0:1787579466.853973:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591749248 00000100:00100000:0.0:1787579466.854034:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 20 00000100:00100000:0.0:1787579466.854058:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:803d6039-c137-4d52-85de-c5895e5f2411+11:2359:x1874412591749248:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579466.854073:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579466.854091:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce813fc400/0xb72beeaffa1b6fa6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf1e expref: 11 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579466.854108:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579466.854162:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:803d6039-c137-4d52-85de-c5895e5f2411+10:2359:x1874412591749248:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 105us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579466.854169:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 20 00000100:00100000:2.0:1787579466.854633:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591749120 00000100:00100000:2.0:1787579466.854638:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591749120 00000100:00100000:2.0:1787579466.854677:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 74 00000100:00100000:2.0:1787579466.854685:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec14b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+7:2358:x1874412591749120:12345-192.168.206.53@tcp:9:umount.0 00000020:00000080:2.0:1787579466.854718:0:6710:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b72cb 00000020:00010000:2.0:1787579466.854725:0:6710:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa0ce86534000: total 0 00000100:00080000:2.0:1787579466.854730:0:6710:0:(import.c:65:import_set_state_nolock()) ffffa0ce86533000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787579466.854774:0:6710:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1787579466.855035:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec14b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:963d8c17-1326-491b-be60-9002b9296555+5:2358:x1874412591749120:12345-192.168.206.53@tcp:9:umount.0 Request processed in 350us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579466.855042:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 74 00000020:00010000:3.0:1787579466.855098:0:8475:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa0ce86534000: total 0 00010000:00010000:3.0:1787579466.855127:0:8475:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa0ce86534000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1787579466.855173:0:8475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082c9f210/0xb72beeaffa1b766e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0f3 expref: 4 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579466.855202:0:8475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000245d339/0xb72beeaffa1b7d0c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2c1 expref: 3 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579466.855219:0:8475:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa0ce86534000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1787579466.855230:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579466.855232:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579466.855233:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579466.864787:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579466.864951:0:7660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591749376 00000100:00100000:0.0:1787579466.864960:0:7660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591749376 00000100:00100000:0.0:1787579466.865020:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 75 00000100:00100000:0.0:1787579466.865030:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+5:2358:x1874412591749376:12345-192.168.206.53@tcp:9:umount.0 00000020:00000080:0.0:1787579466.865056:0:7660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b706a 00000100:00080000:0.0:1787579466.865064:0:7660:0:(import.c:65:import_set_state_nolock()) ffffa0cebf6b6800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787579466.865108:0:7660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787579466.865362:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:963d8c17-1326-491b-be60-9002b9296555+2:2358:x1874412591749376:12345-192.168.206.53@tcp:9:umount.0 Request processed in 332us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579466.865370:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 75 00010000:00010000:3.0:1787579466.866216:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579466.881120:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579466.881385:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591750400 00000100:00100000:3.0:1787579466.881394:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591750400 00000100:00100000:3.0:1787579466.881449:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 240 00000100:00100000:3.0:1787579466.881458:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+22:2358:x1874412591750400:12345-192.168.206.53@tcp:39:umount.0 00000020:00000080:3.0:1787579466.881495:0:5866:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6d06 00000020:00010000:3.0:1787579466.881509:0:5866:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa0ceb3e16800: total 0 00000100:00080000:3.0:1787579466.881514:0:5866:0:(import.c:65:import_set_state_nolock()) ffffa0ceb44b4000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787579466.881543:0:5866:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:3.0:1787579466.881949:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:963d8c17-1326-491b-be60-9002b9296555+21:2358:x1874412591750400:12345-192.168.206.53@tcp:39:umount.0 Request processed in 466us (812us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1787579466.881971:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 240 00000020:00010000:1.0:1787579466.882581:0:5853:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa0ceb3e16800: total 0 00010000:00010000:1.0:1787579466.882628:0:5853:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa0ceb3e16800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787579466.882659:0:5853:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:1.0:1787579466.882663:0:5853:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787579466.882671:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8a00/0xb72beeaffa1b732d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d01a expref: 20 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579466.882701:0:5853:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0ce86456d00) 00010000:00010000:1.0:1787579466.882704:0:5853:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787579466.882708:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c8400/0xb72beeaffa1b6fd0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf2c expref: 19 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579466.882726:0:5853:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:1.0:1787579466.882729:0:5853:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787579466.882732:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceb47c9000/0xb72beeaffa1b79cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d1e8 expref: 18 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579466.882746:0:5853:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0ce84d55a00) 00010000:00010000:1.0:1787579466.882748:0:5853:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787579466.882751:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e400/0xb72beeaffa1b7040 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf48 expref: 17 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579466.882766:0:5853:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:1.0:1787579466.882775:0:5853:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787579466.882780:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318400/0xb72beeaffa1b7bed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d274 expref: 16 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579466.882794:0:5853:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0cea147d800) 00010000:00010000:1.0:1787579466.882797:0:5853:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787579466.882811:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318c00/0xb72beeaffa1b76ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d116 expref: 15 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579466.882829:0:5853:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:1.0:1787579466.882831:0:5853:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787579466.882834:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce813fca00/0xb72beeaffa1b754f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0a6 expref: 14 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579466.882846:0:5853:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce82cbb500) 00010000:00010000:1.0:1787579466.882848:0:5853:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787579466.882852:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8c00/0xb72beeaffa1b76d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d10f expref: 13 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579466.882862:0:5853:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0ce84d55300) 00010000:00010000:1.0:1787579466.882865:0:5853:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579466.882868:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce8152e600/0xb72beeaffa1b6fec lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf33 expref: 12 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579466.882893:0:5853:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:1.0:1787579466.882895:0:5853:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787579466.882899:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a600/0xb72beeaffa1b7cf7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2ba expref: 11 pid: 9532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579466.882964:0:5853:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:1.0:1787579466.882967:0:5853:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787579466.882972:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b762f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0de expref: 10 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579466.882985:0:5853:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0ce86456300) 00010000:00010000:1.0:1787579466.882988:0:5853:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787579466.882992:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8000/0xb72beeaffa1b7659 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d0ec expref: 9 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579466.883005:0:5853:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0ce84d55d00) 00010000:00010000:1.0:1787579466.883007:0:5853:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787579466.883011:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ce90a8a400/0xb72beeaffa1b7ccd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2ac expref: 8 pid: 9530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579466.883023:0:5853:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa0ceb3e16800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1787579466.883035:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579466.883037:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579466.883038:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579467.168193:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579467.232393:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616891008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787579467.232460:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579467.232543:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616891008 00000100:00100000:3.0:1787579467.232550:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616891008 00000100:00100000:3.0:1787579467.232707:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787579467.232719:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616891008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787579467.232965:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579467.233016:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616891008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 300us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579467.233025:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787579467.233069:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616891008:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1787579467.267923:0:5888:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:3.0:1787579467.267968:0:5888:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 963d8c17-1326-491b-be60-9002b9296555 00000001:00080000:3.0:1787579467.267974:0:5888:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1787579467.267977:0:5888:0:(genops.c:885:class_export_put()) final put ffffa0ceb3e16800/963d8c17-1326-491b-be60-9002b9296555 00000020:00000080:1.0:1787579467.268061:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ceb3e16800/963d8c17-1326-491b-be60-9002b9296555 for lustre-MDT0000 00000020:00000080:1.0:1787579467.268127:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0ceb44b4000 for lustre-MDT0000 00000001:00100000:0.0:1787579467.279465:0:7670:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 963d8c17-1326-491b-be60-9002b9296555 00000020:00000080:0.0:1787579467.279474:0:7670:0:(genops.c:885:class_export_put()) final put ffffa0ce86534000/963d8c17-1326-491b-be60-9002b9296555 00000020:00000080:1.0:1787579467.279589:0:12671:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ce86534000/963d8c17-1326-491b-be60-9002b9296555 for lustre-OST0001 00000020:00000080:1.0:1787579467.279645:0:12671:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0ce86533000 for lustre-OST0001 00000040:00080000:3.0:1787579467.424846:0:11712:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787579467.424856:0:11712:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787579467.430564:0:11712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787579467.430581:0:11712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787579468.192149:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787579468.302910:0:6735:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 963d8c17-1326-491b-be60-9002b9296555 00000020:00000080:0.0:1787579468.302919:0:6735:0:(genops.c:885:class_export_put()) final put ffffa0cebf6b7000/963d8c17-1326-491b-be60-9002b9296555 00000020:00000080:1.0:1787579468.303031:0:12671:0:(genops.c:844:class_export_destroy()) destroying export ffffa0cebf6b7000/963d8c17-1326-491b-be60-9002b9296555 for lustre-OST0000 00000020:00000080:1.0:1787579468.303093:0:12671:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0cebf6b6800 for lustre-OST0000 00000100:00100000:0.0:1787579468.864521:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579468.864556:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579468.864602:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579468.864638:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591750784 00000100:00100000:0.0:1787579468.864646:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591750784 00000100:00100000:0.0:1787579468.864701:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591750528 00000100:00100000:0.0:1787579468.864704:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591750528 00000100:00100000:0.0:1787579468.864716:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591750656 00000100:00100000:0.0:1787579468.864717:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591750656 00000100:00100000:0.0:1787579468.864731:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 21 00000100:00100000:0.0:1787579468.864738:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:803d6039-c137-4d52-85de-c5895e5f2411+12:2360:x1874412591750784:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579468.864752:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579468.864775:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ceba3c9800/0xb72beeaffa1b6f83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01cf17 expref: 12 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579468.864790:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579468.864832:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:803d6039-c137-4d52-85de-c5895e5f2411+11:2360:x1874412591750784:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 94us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579468.864840:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 21 00000100:00100000:0.0:1787579468.864856:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 22 00000100:00100000:0.0:1787579468.864862:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:803d6039-c137-4d52-85de-c5895e5f2411+10:2361:x1874412591750528:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579468.864869:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579468.864877:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce8148a000/0xb72beeaffa1b6dd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce68 expref: 10 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579468.864885:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579468.864900:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:803d6039-c137-4d52-85de-c5895e5f2411+9:2361:x1874412591750528:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 38us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579468.864906:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 22 00000100:00100000:0.0:1787579468.864917:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 23 00000100:00100000:0.0:1787579468.864922:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:803d6039-c137-4d52-85de-c5895e5f2411+8:2361:x1874412591750656:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579468.864967:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579468.864975:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce8152f600/0xb72beeaffa1b6ddf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce92 expref: 8 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579468.864984:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579468.864998:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:803d6039-c137-4d52-85de-c5895e5f2411+7:2361:x1874412591750656:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 76us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579468.865004:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 23 00000100:00100000:2.0:1787579468.880671:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579468.880764:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591751040 00000100:00100000:0.0:1787579468.880773:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591751040 00000100:00100000:0.0:1787579468.880830:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 241 00000100:00100000:0.0:1787579468.880840:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10f8d08d-5315-46af-9d52-63a85ea5c0aa+6:2358:x1874412591751040:12345-192.168.206.53@tcp:39:umount.0 00000020:00000080:0.0:1787579468.880873:0:9532:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6ded 00000020:00010000:0.0:1787579468.880881:0:9532:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa0ce83120000: total 0 00000100:00080000:0.0:1787579468.880885:0:9532:0:(import.c:65:import_set_state_nolock()) ffffa0ce83122800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787579468.880914:0:9532:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1787579468.881271:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10f8d08d-5315-46af-9d52-63a85ea5c0aa+5:2358:x1874412591751040:12345-192.168.206.53@tcp:39:umount.0 Request processed in 432us (609us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1787579468.881279:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 241 00000020:00010000:3.0:1787579468.881596:0:8476:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa0ce83120000: total 0 00010000:00010000:3.0:1787579468.881632:0:8476:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa0ce83120000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787579468.881661:0:8476:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce82cbb500) 00010000:00010000:3.0:1787579468.881664:0:8476:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787579468.881673:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b7d1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2c8 expref: 4 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579468.881708:0:8476:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa0ce83120000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787579468.881718:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579468.881720:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579468.881722:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787579468.881957:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579468.924087:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579468.924264:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591751296 00000100:00100000:3.0:1787579468.924276:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591751296 00000100:00100000:3.0:1787579468.924386:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 301 00000100:00100000:3.0:1787579468.924397:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce83128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+7:2358:x1874412591751296:12345-192.168.206.53@tcp:251:umount.0 00000020:00000080:3.0:1787579468.924435:0:5859:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6ce3 00000020:00010000:3.0:1787579468.924441:0:5859:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa0cebfaa3000: total 0 00000100:00080000:3.0:1787579468.924446:0:5859:0:(import.c:65:import_set_state_nolock()) ffffa0cebfaa6800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1787579468.924709:0:5853:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa0cebfaa3000: total 0 00010000:00010000:0.0:1787579468.924713:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579468.924754:0:5853:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa0cebfaa3000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787579468.924782:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce813fcc00/0xb72beeaffa1b6d99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01ce5a expref: 3 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579468.924797:0:5853:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa0cebfaa3000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1787579468.924819:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579468.924820:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579468.924822:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579468.925568:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce83128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:803d6039-c137-4d52-85de-c5895e5f2411+1:2358:x1874412591751296:12345-192.168.206.53@tcp:251:umount.0 Request processed in 1165us (1481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579468.925579:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 301 00000020:00000080:3.0:1787579468.925599:0:5859:0:(genops.c:885:class_export_put()) final put ffffa0cebfaa3000/803d6039-c137-4d52-85de-c5895e5f2411 00000020:00000080:0.0:1787579468.926066:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffffa0cebfaa3000/803d6039-c137-4d52-85de-c5895e5f2411 for MGS 00000020:00000080:0.0:1787579468.926101:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0cebfaa6800 for MGS 00010000:00010000:2.0:1787579469.216165:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579470.240594:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787579470.346849:0:13097:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1787579470.355057:0:13097:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787579470.355104:0:13097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6d68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6d6f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579470.355118:0:13097:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6d68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6d6f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579470.355126:0:13097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6d68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb72beeaffa1b6d6f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579470.355134:0:13097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6d68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb72beeaffa1b6d6f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579470.355162:0:13097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787579470.355167:0:13097:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787579470.355191:0:13097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787579470.355195:0:13097:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787579470.355201:0:13097:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787579470.355225:0:13097:0:(import.c:65:import_set_state_nolock()) ffffa0ceb4380000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1787579470.355280:0:8476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787579470.355287:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6d68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb72beeaffa1b6d6f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579470.355306:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb3f79e00 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:2.0:1787579470.355310:0:8476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6d68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb72beeaffa1b6d6f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579470.355318:0:8476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6d68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xb72beeaffa1b6d6f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787579470.355325:0:8476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6d68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xb72beeaffa1b6d6f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579470.355330:0:8476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787579470.355333:0:8476:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787579470.355336:0:8476:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787579470.355361:0:8476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6d68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb72beeaffa1b6d6f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579470.355367:0:8476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787579470.355416:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebf834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616891264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787579470.355479:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787579470.355549:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6d68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb72beeaffa1b6d6f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579470.355558:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79e00/0xb72beeaffa1b6d68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb72beeaffa1b6d6f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579470.355570:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579470.355572:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579470.355574:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579470.355585:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874412616891136:0@lo:39:umount.0 00000100:00100000:2.0:1787579470.355617:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579470.355652:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616891264 00000100:00100000:0.0:1787579470.355658:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616891264 00000100:00100000:2.0:1787579470.355664:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616891136 00000100:00100000:2.0:1787579470.355688:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616891136 00000100:00100000:0.0:1787579470.355712:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787579470.355721:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb468b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3321:x1874412616891264:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787579470.355731:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00010000:00010000:0.0:1787579470.355734:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787579470.355742:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874412616891136:12345-0@lo:39:umount.0 00010000:00010000:0.0:1787579470.355751:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce8152e800/0xb72beeaffa1b6d6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb72beeaffa1b6d68 expref: 19 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787579470.355766:0:5867:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6b0e 00010000:00010000:0.0:1787579470.355768:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1787579470.355777:0:5867:0:(import.c:65:import_set_state_nolock()) ffffa0cec11d1800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787579470.355840:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3318:x1874412616891136:12345-0@lo:39:umount.0 Request processed in 102us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579470.355847:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1787579470.355861:0:5867:0:(genops.c:885:class_export_put()) final put ffffa0cec11d0800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1787579470.355889:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787579470.355898:0:12671:0:(genops.c:844:class_export_destroy()) destroying export ffffa0cec11d0800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787579470.355963:0:12671:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0cec11d1800 for lustre-MDT0000 00000100:00080000:2.0:1787579470.355993:0:3318:0:(import.c:65:import_set_state_nolock()) ffffa0ceb4380000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787579470.356004:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874412616891136:0@lo:39:umount.0 00000100:00100000:0.0:1787579470.356070:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb468b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:3321:x1874412616891264:12345-0@lo:103:ldlm_bl.0 Request processed in 351us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579470.356076:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787579470.356085:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebf834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616891264:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787579470.356107:0:13097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787579470.356110:0:13097:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787579470.356114:0:13097:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787579470.357835:0:13097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79600/0xb72beeaffa1b6d76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6d7d expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579470.357859:0:13097:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79600/0xb72beeaffa1b6d76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6d7d expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579470.357864:0:13097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79600/0xb72beeaffa1b6d76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xb72beeaffa1b6d7d expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579470.357867:0:13097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79600/0xb72beeaffa1b6d76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xb72beeaffa1b6d7d expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579470.357888:0:13097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787579470.357892:0:13097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b400/0xb72beeaffa1b6cd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6cdc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579470.357896:0:13097:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b400/0xb72beeaffa1b6cd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6cdc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579470.357899:0:13097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b400/0xb72beeaffa1b6cd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb72beeaffa1b6cdc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579470.357902:0:13097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b400/0xb72beeaffa1b6cd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb72beeaffa1b6cdc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579470.357911:0:13097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787579470.357915:0:13097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6f98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6f9f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579470.357918:0:13097:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6f98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6f9f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579470.357944:0:13097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6f98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb72beeaffa1b6f9f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579470.357948:0:13097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6f98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb72beeaffa1b6f9f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579470.357958:0:13097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787579470.357962:0:8475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787579470.357963:0:13097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce80030800/0xb72beeaffa1b6a5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6a66 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579470.357971:0:13097:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce80030800/0xb72beeaffa1b6a5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6a66 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579470.357974:0:8475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79600/0xb72beeaffa1b6d76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xb72beeaffa1b6d7d expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579470.357976:0:13097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce80030800/0xb72beeaffa1b6a5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb72beeaffa1b6a66 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579470.357992:0:13097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.153@tcp lock: ffffa0ce80030800/0xb72beeaffa1b6a5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb72beeaffa1b6a66 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579470.358000:0:13097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1787579470.358002:0:13097:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1787579470.358019:0:13097:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787579470.358021:0:13097:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1787579470.358024:0:13097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787579470.358027:0:13097:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:1.0:1787579470.358032:0:13097:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffffa0ceb44b2000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787579470.358036:0:13097:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffffa0cebf6b3800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787579470.358041:0:13097:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffffa0ce83120000 10f8d08d-5315-46af-9d52-63a85ea5c0aa 192.168.206.53@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787579470.358048:0:13097:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffffa0ceb48599b8) has exports, disconnecting them 00000020:00080000:1.0:1787579470.358051:0:13097:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa0ceb44b2000), last request at 1787579466 00000020:00000080:1.0:1787579470.358057:0:13097:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6c96 00000100:00080000:1.0:1787579470.358066:0:13097:0:(import.c:65:import_set_state_nolock()) ffffa0ceb44b6800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787579470.358090:0:13097:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0ceb44b2000): rc 0 00000020:00000080:1.0:1787579470.358092:0:13097:0:(genops.c:885:class_export_put()) final put ffffa0ceb44b2000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:3.0:1787579470.358137:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787579470.358141:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b400/0xb72beeaffa1b6cd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb72beeaffa1b6cdc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579470.358146:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148b400 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:3.0:1787579470.358149:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b400/0xb72beeaffa1b6cd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb72beeaffa1b6cdc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579470.358157:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b400/0xb72beeaffa1b6cd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb72beeaffa1b6cdc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787579470.358164:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b400/0xb72beeaffa1b6cd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb72beeaffa1b6cdc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579470.358169:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787579470.358171:0:5854:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787579470.358174:0:5854:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787579470.358205:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b400/0xb72beeaffa1b6cd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb72beeaffa1b6cdc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579470.358218:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787579470.358245:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b400/0xb72beeaffa1b6cd5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb72beeaffa1b6cdc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579470.358252:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b400/0xb72beeaffa1b6cd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb72beeaffa1b6cdc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579470.358265:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787579470.358268:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6f98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb72beeaffa1b6f9f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579470.358273:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148a200 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:3.0:1787579470.358276:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6f98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb72beeaffa1b6f9f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579470.358283:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6f98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb72beeaffa1b6f9f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787579470.358289:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6f98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb72beeaffa1b6f9f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579470.358294:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787579470.358296:0:5854:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787579470.358297:0:5854:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787579470.358310:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6f98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb72beeaffa1b6f9f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579470.358316:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787579470.358328:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6f98 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb72beeaffa1b6f9f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579470.358343:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a200/0xb72beeaffa1b6f98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb72beeaffa1b6f9f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579470.358345:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616891520:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787579470.358352:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787579470.358355:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce80030800/0xb72beeaffa1b6a5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb72beeaffa1b6a66 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579470.358360:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce80030800 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:3.0:1787579470.358363:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce80030800/0xb72beeaffa1b6a5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb72beeaffa1b6a66 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579470.358369:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce80030800/0xb72beeaffa1b6a5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb72beeaffa1b6a66 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787579470.358375:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce80030800/0xb72beeaffa1b6a5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb72beeaffa1b6a66 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579470.358379:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787579470.358381:0:5854:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787579470.358382:0:5854:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787579470.358394:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ce80030800/0xb72beeaffa1b6a5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb72beeaffa1b6a66 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579470.358399:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787579470.358405:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce80030800/0xb72beeaffa1b6a5f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb72beeaffa1b6a66 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579470.358407:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787579470.358411:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce80030800/0xb72beeaffa1b6a5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb72beeaffa1b6a66 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579470.358431:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579470.358433:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579470.358435:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579470.358443:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787579470.358443:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787579470.358449:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616891648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787579470.358450:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616891392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787579470.358470:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579470.358486:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616891520 00000100:00100000:3.0:1787579470.358492:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616891520 00000100:00100000:2.0:1787579470.358496:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616891648 00000100:00100000:2.0:1787579470.358498:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616891648 00000100:00100000:3.0:1787579470.358529:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787579470.358537:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce831d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+19:3319:x1874412616891520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787579470.358548:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579470.358560:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce8148bc00/0xb72beeaffa1b6f9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb72beeaffa1b6f98 expref: 19 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579470.358572:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579470.358607:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce831d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+18:3319:x1874412616891520:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579470.358613:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787579470.358653:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787579470.358660:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf834a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:3319:x1874412616891648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787579470.358667:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579470.358695:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce813fd800/0xb72beeaffa1b6a66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb72beeaffa1b6a5f expref: 17 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579470.358706:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579470.358729:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf834a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:3319:x1874412616891648:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579470.358744:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1787579470.358757:0:8475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb3f79600 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:0.0:1787579470.358763:0:8475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79600/0xb72beeaffa1b6d76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xb72beeaffa1b6d7d expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579470.358772:0:8475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79600/0xb72beeaffa1b6d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xb72beeaffa1b6d7d expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787579470.358778:0:8475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79600/0xb72beeaffa1b6d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xb72beeaffa1b6d7d expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787579470.358790:0:13097:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa0cebf6b3800), last request at 1787579466 00000020:00000080:1.0:1787579470.358799:0:13097:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6ba8 10000000:01000000:0.0:1787579470.358799:0:8475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787579470.358804:0:8475:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00000100:00080000:1.0:1787579470.358807:0:13097:0:(import.c:65:import_set_state_nolock()) ffffa0cebf6b3000 : changing import state from FULL to CLOSED 10000000:01000000:0.0:1787579470.358807:0:8475:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:00080000:1.0:1787579470.358822:0:13097:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0cebf6b3800): rc 0 00000020:00000080:1.0:1787579470.358826:0:13097:0:(genops.c:885:class_export_put()) final put ffffa0cebf6b3800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:0.0:1787579470.358826:0:8475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79600/0xb72beeaffa1b6d76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb72beeaffa1b6d7d expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:1.0:1787579470.358833:0:13097:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaf09c1cbfae0 00010000:00010000:0.0:1787579470.358834:0:8475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787579470.358843:0:8475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79600/0xb72beeaffa1b6d76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb72beeaffa1b6d7d expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579470.358850:0:8475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79600/0xb72beeaffa1b6d76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb72beeaffa1b6d7d expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787579470.358852:0:13097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787579470.358857:0:13097:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00010000:00010000:0.0:1787579470.358862:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579470.358865:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579470.358867:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787579470.358872:0:13097:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787579470.358950:0:13097:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787579470.358962:0:13097:0:(import.c:65:import_set_state_nolock()) ffffa0cebf39d800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787579470.358977:0:13097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787579470.358980:0:13097:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1787579470.358991:0:13097:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787579470.359002:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616891904:0@lo:9:umount.0 00000100:00100000:0.0:1787579470.359038:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787579470.359054:0:13097:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787579470.359064:0:13097:0:(import.c:65:import_set_state_nolock()) ffffa0ceb3d49800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787579470.359088:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616892032:0@lo:9:umount.0 00000020:00080000:1.0:1787579470.359099:0:13097:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffffa0ceb48599b8) has no exports 00000100:00100000:0.0:1787579470.359116:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579470.359143:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616891904 00000100:00100000:1.0:1787579470.359148:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616891904 00000100:00100000:1.0:1787579470.359187:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616892032 00000100:00100000:1.0:1787579470.359190:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616892032 00000100:00100000:1.0:1787579470.359208:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787579470.359215:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1874412616891904:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787579470.359238:0:6712:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6c03 00000100:00080000:1.0:1787579470.359243:0:6712:0:(import.c:65:import_set_state_nolock()) ffffa0cebf6b4800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787579470.359267:0:6712:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:0.0:1787579470.359273:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787579470.359278:0:5862:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787579470.359294:0:7660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787579470.359317:0:7660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1874412616892032:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787579470.359332:0:7660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6ca4 00000100:00080000:0.0:1787579470.359339:0:7660:0:(import.c:65:import_set_state_nolock()) ffffa0cebf25e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787579470.359371:0:7660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1787579470.359647:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3318:x1874412616891904:12345-0@lo:9:umount.0 Request processed in 431us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579470.359654:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787579470.359664:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616891648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787579470.359689:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616891520:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787579470.359742:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579470.359778:0:7660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3318:x1874412616892032:12345-0@lo:9:umount.0 Request processed in 463us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579470.359792:0:7660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00010000:0.0:1787579470.359813:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579470.359817:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787579470.359828:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616891776:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787579470.359833:0:3318:0:(import.c:65:import_set_state_nolock()) ffffa0ceb3d49800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787579470.359852:0:3318:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787579470.359855:0:3318:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787579470.359859:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616892032:0@lo:9:umount.0 00000100:00100000:2.0:1787579470.359864:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787579470.359873:0:3318:0:(import.c:65:import_set_state_nolock()) ffffa0cebf39d800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787579470.359884:0:3318:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787579470.359886:0:3318:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787579470.359890:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616891904:0@lo:9:umount.0 00010000:00010000:2.0:1787579470.359912:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579470.359923:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787579470.359963:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787579470.359970:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ceb44b2000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787579470.360010:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffffa0cebf6b3800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787579470.360030:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0ceb44b6800 for lustre-MDT0000 00000020:00000080:2.0:1787579470.360034:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0cebf6b3000 for lustre-MDT0000 00000100:00100000:2.0:1787579470.360051:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616891776 00000100:00100000:2.0:1787579470.360055:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616891776 00000100:00100000:2.0:1787579470.360085:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616891392 00000100:00100000:2.0:1787579470.360089:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616891392 00000100:00100000:0.0:1787579470.360110:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787579470.360119:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf836a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:3322:x1874412616891776:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787579470.360122:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1787579470.360133:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787579470.360137:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+17:3321:x1874412616891392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787579470.360147:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce813fc200/0xb72beeaffa1b6d7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb72beeaffa1b6d76 expref: 17 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579470.360158:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579470.360190:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf836a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+16:3322:x1874412616891776:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579470.360198:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1787579470.360207:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579470.360221:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ceb3f79a00/0xb72beeaffa1b6cdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb72beeaffa1b6cd5 expref: 15 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579470.360234:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579470.360274:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:3321:x1874412616891392:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579470.360281:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787579470.360435:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616891776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787579470.361966:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616891392:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1787579470.369832:0:13097:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffffa0ceb48599b8) has no exports 00000020:00000080:1.0:1787579470.413620:0:13097:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6aba 00000020:00000080:1.0:1787579470.413705:0:13097:0:(genops.c:885:class_export_put()) final put ffffa0ceb4860800/lustre-QMT0000_UUID 00000020:01000000:1.0:1787579470.413730:0:13097:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787579470.413821:0:13097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787579470.413832:0:13097:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787579470.413836:0:13097:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffffa0ceb59199b8) has no exports 00000020:00000080:2.0:1787579470.413880:0:12671:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ceb4860800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787579470.414275:0:13097:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6ab3 00000020:00000080:0.0:1787579470.414282:0:13097:0:(genops.c:885:class_export_put()) final put ffffa0cec11d4800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787579470.414343:0:13097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787579470.414351:0:13097:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787579470.414355:0:13097:0:(genops.c:885:class_export_put()) final put ffffa0ceb5912800/lustre-QMT0000_UUID 00000020:00000080:0.0:1787579470.414371:0:13097:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ceb5912800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787579470.414384:0:13097:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1787579470.414545:0:12671:0:(genops.c:844:class_export_destroy()) destroying export ffffa0cec11d4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1787579471.271585:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579471.840788:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3320:1874412616892416:0@lo:400:kworker.0 00000100:00100000:0.0:1787579471.840852:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579471.840944:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787579471.840951:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1874412616892288:0@lo:400:kworker.0 00000100:00100000:0.0:1787579471.840976:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579471.841004:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616892416 00000100:00100000:0.0:1787579471.841011:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616892416 00000100:00100000:0.0:1787579471.841042:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616892288 00000100:00100000:0.0:1787579471.841046:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616892288 00000100:00100000:0.0:1787579471.841063:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787579471.841070:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3320:x1874412616892416:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787579471.841077:0:5868:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787579471.841115:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3320:x1874412616892416:12345-0@lo:400:kworker.0 Request processed in 43us (262us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787579471.841122:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787579471.841137:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787579471.841142:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3320:x1874412616892288:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787579471.841146:0:5868:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787579471.841167:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3320:x1874412616892288:12345-0@lo:400:kworker.0 Request processed in 24us (191us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787579471.841173:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787579471.841427:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616892160:0@lo:400:kworker.0 00000100:00100000:2.0:1787579471.841477:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579471.841513:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616892160 00000100:00100000:2.0:1787579471.841517:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616892160 00000100:00100000:2.0:1787579471.841563:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1787579471.841570:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8312a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:3322:x1874412616892160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579471.841610:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8312a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58d0ce6f-950d-4003-ac33-0f50e03ceaf8+14:3322:x1874412616892160:12345-0@lo:400:kworker.0 Request processed in 40us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579471.841616:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1787579471.841654:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616892160:0@lo:400:kworker.0 00000100:00080000:1.0:1787579471.844801:0:3320:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787579471.844808:0:3320:0:(import.c:65:import_set_state_nolock()) ffffa0cebf6b2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787579471.844812:0:3320:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787579471.872365:0:3320:0:(import.c:65:import_set_state_nolock()) ffffa0cebf6b2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787579471.872378:0:3320:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 205 00000100:00080000:1.0:1787579471.872387:0:3320:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa0cebf6b2800 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:1.0:1787579471.872436:0:3320:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ceb4688380 x1874412616892544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787579471.872530:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1874412616892288:0@lo:400:kworker.0 00000100:00080000:1.0:1787579471.872559:0:3320:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787579471.872564:0:3320:0:(import.c:65:import_set_state_nolock()) ffffa0ceb44b0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787579471.872567:0:3320:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787579471.872570:0:3320:0:(import.c:65:import_set_state_nolock()) ffffa0ceb44b0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787579471.872574:0:3320:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 223 00000100:00080000:1.0:1787579471.872591:0:3320:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa0ceb44b0000 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:1.0:1787579471.872604:0:3320:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ceb468a680 x1874412616892672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787579471.872615:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3320:1874412616892416:0@lo:400:kworker.0 00000100:00100000:0.0:1787579471.872888:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3318:1874412616892544:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1787579471.873149:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579471.873185:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3318:1874412616892672:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1787579471.873280:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616892544 00000100:00100000:2.0:1787579471.873288:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616892544 00000100:00100000:2.0:1787579471.873333:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787579471.873342:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3318:x1874412616892544:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1787579471.873358:0:5866:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787579471.875057:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579471.875530:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616892672 00000100:00100000:1.0:1787579471.875537:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616892672 00000100:00100000:1.0:1787579471.875577:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787579471.875584:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3318:x1874412616892672:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1787579471.875598:0:9532:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787579471.875644:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3318:x1874412616892672:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 59us (588us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787579471.875651:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:0.0:1787579471.878005:0:3318:0:(import.c:65:import_set_state_nolock()) ffffa0ceb44b0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787579471.878014:0:3318:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787579471.878020:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3318:1874412616892672:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1787579471.889316:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3318:x1874412616892544:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 15967us (16161us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787579471.889329:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1787579471.889537:0:3318:0:(import.c:65:import_set_state_nolock()) ffffa0cebf6b2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787579471.889544:0:3318:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787579471.889548:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3318:1874412616892544:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:0.0:1787579472.288084:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787579472.427017:0:7670:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787579472.427026:0:7670:0:(genops.c:885:class_export_put()) final put ffffa0cebf25d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787579472.427051:0:12671:0:(genops.c:844:class_export_destroy()) destroying export ffffa0cebf25d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787579472.427086:0:12671:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0cebf25e800 for lustre-OST0001 00000001:00100000:3.0:1787579472.453746:0:5888:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 10f8d08d-5315-46af-9d52-63a85ea5c0aa 00000001:00080000:3.0:1787579472.453764:0:5888:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1787579472.453768:0:5888:0:(genops.c:885:class_export_put()) final put ffffa0ce83120000/10f8d08d-5315-46af-9d52-63a85ea5c0aa 00000020:00000080:2.0:1787579472.453824:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ce83120000/10f8d08d-5315-46af-9d52-63a85ea5c0aa for lustre-MDT0000 00000020:00000080:2.0:1787579472.453875:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0ce83122800 for lustre-MDT0000 00010000:00010000:2.0:1787579473.312264:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787579473.422525:0:6735:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787579473.422533:0:6735:0:(genops.c:885:class_export_put()) final put ffffa0cebf6b5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787579473.422886:0:12671:0:(genops.c:844:class_export_destroy()) destroying export ffffa0cebf6b5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787579473.422966:0:12671:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0cebf6b4800 for lustre-OST0000 00010000:00010000:2.0:1787579474.336417:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579475.360480:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579476.384762:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787579476.448886:0:13097:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0ce87df7de0 - data ffffa0ceaf05c870/ffffa0cebc491c00 00000020:01000000:0.0:1787579476.449133:0:13097:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0ce91f31180 - data ffffa0cea6333438/ffffa0cec11c5800 00000001:00000004:0.0:1787579476.458336:0:13097:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:1.0:1787579476.617879:0:13097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787579476.617886:0:13097:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1787579476.618023:0:13097:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787579476.618027:0:13097:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787579476.618390:0:7182:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787579476.618396:0:7182:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1787579476.618405:0:7182:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1787579476.619456:0:13097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787579476.619460:0:13097:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1787579476.619480:0:13097:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787579476.619482:0:13097:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787579476.619822:0:7656:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787579476.619827:0:7656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1787579476.619836:0:7656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787579476.656871:0:13097:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6a82 00000020:00000080:3.0:1787579476.656883:0:13097:0:(genops.c:885:class_export_put()) final put ffffa0ceb313d800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787579476.658114:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ceb313d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787579476.658292:0:13097:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6a97 00000020:00000080:3.0:1787579476.658301:0:13097:0:(genops.c:885:class_export_put()) final put ffffa0ceb4863000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787579476.658318:0:13097:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1787579476.658329:0:13097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787579476.658337:0:13097:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787579476.658341:0:13097:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffffa0ce98723370) has no exports 00000020:00000080:2.0:1787579476.658494:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ceb4863000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1787579476.658505:0:13097:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787579476.658513:0:13097:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6c3b 00000020:00000080:3.0:1787579476.658518:0:13097:0:(genops.c:885:class_export_put()) final put ffffa0cebf25c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787579476.658527:0:13097:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787579476.658531:0:13097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787579476.658532:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffffa0cebf25c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787579476.658537:0:13097:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787579476.658540:0:13097:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffffa0ceb3d58000) has no exports 00000020:00000080:3.0:1787579476.658545:0:13097:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6c34 00000020:00000080:3.0:1787579476.658549:0:13097:0:(genops.c:885:class_export_put()) final put ffffa0ceb3d48800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787579476.658571:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ceb3d48800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787579476.659395:0:13097:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787579476.659399:0:13097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787579476.659416:0:13097:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1787579476.659422:0:13097:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787579476.659425:0:13097:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787579476.659471:0:13097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787579476.659479:0:13097:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787579476.659488:0:13097:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6bee 00000020:00000080:3.0:1787579476.659493:0:13097:0:(genops.c:885:class_export_put()) final put ffffa0ceb3139800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787579476.659497:0:13097:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787579476.659500:0:13097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787579476.659503:0:13097:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787579476.659505:0:13097:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffffa0ce8674cd28) has no exports 00000020:00000080:3.0:1787579476.659509:0:13097:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6be7 00000020:00000080:3.0:1787579476.659511:0:13097:0:(genops.c:885:class_export_put()) final put ffffa0cebf39a800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787579476.659689:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0ceb3d49800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787579476.659696:0:479:0:(genops.c:885:class_export_put()) final put ffffa0ceb3d4b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787579476.659699:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ceb3d4b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1787579476.659705:0:479:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787579476.659907:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ceb3139800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787579476.659912:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffffa0cebf39a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787579476.660509:0:13097:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787579476.660513:0:13097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787579476.660516:0:13097:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1787579476.660520:0:13097:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787579476.660522:0:13097:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787579476.660570:0:13097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787579476.660578:0:13097:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787579476.660627:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0cebf39d800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787579476.660647:0:479:0:(genops.c:885:class_export_put()) final put ffffa0cebf399800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787579476.660649:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffffa0cebf399800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787579476.660655:0:479:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787579476.660721:0:13097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787579476.660727:0:13097:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787579476.660730:0:13097:0:(genops.c:885:class_export_put()) final put ffffa0ceb313a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787579476.660733:0:13097:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ceb313a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787579476.660742:0:13097:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787579476.661788:0:13097:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6a9e 00000020:00000080:2.0:1787579476.661797:0:13097:0:(genops.c:885:class_export_put()) final put ffffa0ceb4863800/lustre-MDD0000_UUID 00000020:01000000:2.0:1787579476.661812:0:13097:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787579476.661817:0:13097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787579476.661823:0:13097:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787579476.661827:0:13097:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffffa0ceb4858000) has no exports 00000020:00000080:3.0:1787579476.661882:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ceb4863800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1787579476.661906:0:13097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787579476.661911:0:13097:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787579476.661914:0:13097:0:(genops.c:885:class_export_put()) final put ffffa0ceb313b000/lustre-MDD0000_UUID 00000020:00000080:2.0:1787579476.661916:0:13097:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ceb313b000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1787579476.661920:0:13097:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787579476.662239:0:13097:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6aa5 00000020:00000080:3.0:1787579476.662245:0:13097:0:(genops.c:885:class_export_put()) final put ffffa0ceb4865800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787579476.662291:0:13097:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0ce90be4800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1787579476.662295:0:13097:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0ce90be4800 3 00000020:01000004:3.0:1787579476.662298:0:13097:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa0ce90be4800 from lustre-MDT0000 00000020:00000080:3.0:1787579476.662334:0:13097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787579476.662339:0:13097:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1787579476.662342:0:13097:0:(genops.c:885:class_export_put()) final put ffffa0ceb3139000/lustre-MDT0000_UUID 00000020:00000080:3.0:1787579476.662345:0:13097:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ceb3139000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1787579476.662353:0:13097:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1787579476.662380:0:13097:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1787579476.662383:0:13097:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1787579476.662385:0:13097:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1787579476.662388:0:13097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787579476.662391:0:13097:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787579476.662396:0:13097:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffffa0ce84f52000 58d0ce6f-950d-4003-ac33-0f50e03ceaf8 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787579476.662401:0:13097:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffffa0ce987219b8) has exports, disconnecting them 00000020:00080000:3.0:1787579476.662405:0:13097:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffffa0ce84f52000), last request at 1787579253 00000020:00000080:3.0:1787579476.662417:0:13097:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6a43 00000020:00010000:3.0:1787579476.662421:0:13097:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa0ce84f52000: total 1 00000100:00080000:3.0:1787579476.662426:0:13097:0:(import.c:65:import_set_state_nolock()) ffffa0ce84f54800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787579476.662445:0:13097:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0ce84f52000): rc 0 00000020:00080000:3.0:1787579476.662449:0:13097:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffffa0ce987219b8) has no exports 00000100:00100000:3.0:1787579476.662503:0:5859:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffffa0ce867dc000:5859] 0 exiting: rc = 1 00000100:00100000:0.0:1787579476.662518:0:5861:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffffa0ce867dcc00:5861] 2 exiting: rc = 0 00000020:00000080:2.0:1787579476.662581:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ceb4865800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:1.0:1787579476.662592:0:5853:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa0ce84f52000: total 0 00000100:00100000:2.0:1787579476.662606:0:5860:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffffa0ce867dd400:5860] 1 exiting: rc = 0 00010000:00010000:1.0:1787579476.662629:0:5853:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa0ce84f52000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1787579476.662674:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce8148ac00/0xb72beeaffa1b6f7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb72beeaffa1b6f75 expref: 9 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579476.662709:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce813fc800/0xb72beeaffa1b6d8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb72beeaffa1b6d84 expref: 8 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579476.662720:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce80031a00/0xb72beeaffa1b6b5b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb72beeaffa1b6b54 expref: 7 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579476.662735:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce8148ba00/0xb72beeaffa1b6f91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb72beeaffa1b6f8a expref: 6 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579476.662747:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce80031c00/0xb72beeaffa1b6d37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb72beeaffa1b6d30 expref: 5 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579476.662756:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce80031400/0xb72beeaffa1b6d45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb72beeaffa1b6d3e expref: 4 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579476.662766:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce8152f200/0xb72beeaffa1b6d53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb72beeaffa1b6d4c expref: 3 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579476.662777:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce813fda00/0xb72beeaffa1b6d61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb72beeaffa1b6d5a expref: 2 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579476.662788:0:5853:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa0ce84f52000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1787579476.662801:0:5853:0:(genops.c:885:class_export_put()) final put ffffa0ce84f52000/58d0ce6f-950d-4003-ac33-0f50e03ceaf8 00010000:00010000:1.0:1787579476.662812:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579476.662814:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579476.662816:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787579476.662822:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ce84f52000/58d0ce6f-950d-4003-ac33-0f50e03ceaf8 for MGS 00000100:00100000:3.0:1787579476.662896:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.662906:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.662913:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.662918:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.662941:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.662947:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.662953:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.662958:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.662964:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.662969:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.662975:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.662980:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.662985:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.662998:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663004:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663009:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663015:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663021:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663027:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663032:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663038:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663044:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663050:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663055:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663062:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663074:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663080:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663086:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663091:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663097:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663102:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663108:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663113:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663118:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663123:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663128:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663133:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663138:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663143:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663149:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663154:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663159:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663164:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663170:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663174:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663179:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663184:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663192:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663204:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663209:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663215:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663220:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663226:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663231:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663235:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663241:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663246:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663252:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663258:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663264:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663269:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663275:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663280:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.663289:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787579476.663505:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0ce84f54800 for MGS 20000000:01000000:3.0:1787579476.663698:0:13097:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787579476.663701:0:13097:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1787579476.664210:0:13097:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0ce84f0aae0 - data ffffa0cea61faca8/ffffa0cec1415000 00000020:01000000:3.0:1787579476.664388:0:13097:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0ce87b08de0 - data ffffa0ceaf052870/ffffa0ce84ee3400 00000020:00000080:3.0:1787579476.664948:0:13097:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6a27 00000020:00000080:3.0:1787579476.664955:0:13097:0:(genops.c:885:class_export_put()) final put ffffa0ce9045f000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787579476.664968:0:13097:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0ce90be4800 from MGS, refs=2 00000020:01000004:3.0:1787579476.664971:0:13097:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0ce90be4800 2 00000020:01000004:3.0:1787579476.664973:0:13097:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa0ce90be4800 from MGS 00000020:00000080:1.0:1787579476.664985:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ce9045f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787579476.664991:0:13097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787579476.664998:0:13097:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1787579476.665001:0:13097:0:(genops.c:885:class_export_put()) final put ffffa0ce9045b000/MGS 00000020:00000080:3.0:1787579476.665003:0:13097:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ce9045b000/MGS for MGS 00000020:01000000:3.0:1787579476.665009:0:13097:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1787579476.665057:0:13097:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1787579476.665061:0:13097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787579476.665067:0:13097:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787579476.665073:0:13097:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffffa0ceb5916800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787579476.665085:0:13097:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffffa0ceb5918000) has exports, disconnecting them 00000020:00080000:3.0:1787579476.665091:0:13097:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffffa0ceb5916800), last request at 1787579254 00000020:00000080:3.0:1787579476.665095:0:13097:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6af2 00000020:00080000:3.0:1787579476.665107:0:13097:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0ceb5916800): rc 0 00000020:00000080:3.0:1787579476.665111:0:13097:0:(genops.c:885:class_export_put()) final put ffffa0ceb5916800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787579476.665262:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ceb5916800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787579476.665980:0:13097:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787579476.665990:0:13097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787579476.665994:0:13097:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787579476.665998:0:13097:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787579476.666133:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0ceb4380000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787579476.666169:0:13097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787579476.666176:0:13097:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787579476.666179:0:13097:0:(genops.c:885:class_export_put()) final put ffffa0ceb5913000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787579476.666182:0:13097:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ceb5913000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787579476.666186:0:13097:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787579476.666273:0:13097:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0ce90be4800 1 00000020:00000080:2.0:1787579476.666278:0:13097:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6a19 00000020:00000080:2.0:1787579476.666282:0:13097:0:(genops.c:885:class_export_put()) final put ffffa0ce9045a800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787579476.666294:0:13097:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787579476.666297:0:13097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787579476.666300:0:13097:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787579476.666303:0:13097:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffffa0ce867499b8) has no exports 00000020:00000080:1.0:1787579476.666391:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ce9045a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787579476.714628:0:13097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787579476.714649:0:13097:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1787579476.714656:0:13097:0:(genops.c:885:class_export_put()) final put ffffa0ce90be5800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787579476.714661:0:13097:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ce90be5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787579476.714670:0:13097:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1787579476.714795:0:13097:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa0ce90be2000 00000020:01000000:3.0:1787579476.714816:0:13097:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787579476.714820:0:13097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787579476.714823:0:13097:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787579476.714827:0:13097:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffffa0ce98724d28) has no exports 00000100:00100000:3.0:1787579476.715000:0:5868:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffffa0ce97028000:5868] 2 exiting: rc = 0 00000100:00100000:2.0:1787579476.715009:0:9530:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffffa0cebfb24e00:9530] 3 exiting: rc = 0 00000100:00100000:0.0:1787579476.715114:0:5867:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffffa0ce9861f600:5867] 1 exiting: rc = 0 00000100:00100000:3.0:1787579476.716023:0:5866:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffffa0ce87bf9e00:5866] 0 exiting: rc = 1 00000100:00100000:1.0:1787579476.718327:0:9532:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffffa0ce904bae00:9532] 4 exiting: rc = 0 00000100:00100000:3.0:1787579476.718502:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718512:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718520:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718527:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718534:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718542:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718549:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718555:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718562:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718570:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718579:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718587:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718594:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718602:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718609:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718630:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718647:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718656:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718664:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718671:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718678:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718685:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718690:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718695:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718700:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718705:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718711:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718716:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718721:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718728:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718734:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718739:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718744:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718748:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718757:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718766:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718776:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718786:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718795:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718800:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718805:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718810:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718816:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718821:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718826:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718831:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718837:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718842:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718847:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718851:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718864:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718869:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718873:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718878:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718883:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718889:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718894:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718906:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718914:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718919:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718961:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718971:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718979:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.718986:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.731919:0:5870:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffffa0ce87bfae00:5870] 1 exiting: rc = 0 00000100:00100000:0.0:1787579476.732168:0:5869:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffffa0ce9861f000:5869] 0 exiting: rc = 1 00000100:00100000:3.0:1787579476.732277:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732285:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732292:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732298:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732304:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732309:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732315:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732321:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732328:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732334:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732340:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732345:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732352:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732357:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732363:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732368:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732373:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732379:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732386:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732391:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732396:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732415:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732419:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732425:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732429:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732434:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732439:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732444:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732449:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732454:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732459:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732465:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732470:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732474:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732479:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732484:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732489:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732494:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732500:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732506:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732510:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732515:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732519:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732524:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732529:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732534:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732539:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732545:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732550:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732555:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732561:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732571:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732577:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732582:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732586:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732591:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732604:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732610:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732615:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732621:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732627:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732632:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732650:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.732656:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.733375:0:5872:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffffa0ceb1ca7c00:5872] 1 exiting: rc = 0 00000100:00100000:2.0:1787579476.733805:0:5871:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffffa0ceb1ca6e00:5871] 0 exiting: rc = 1 00000100:00100000:0.0:1787579476.734106:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734120:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734132:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734149:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734161:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734171:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734180:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734191:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734201:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734212:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734221:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734356:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734363:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734368:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734373:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734378:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734383:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734397:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734402:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734408:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734414:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734420:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734426:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734445:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734451:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734456:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734462:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734467:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734471:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734476:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734482:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734487:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734493:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734498:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734505:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734522:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734528:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734533:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734538:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734545:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734550:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734556:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734561:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734566:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734571:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734577:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734582:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734597:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734602:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734608:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734613:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734618:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734627:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734634:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734653:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734661:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734668:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734677:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734743:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734904:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.734916:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.735039:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.735047:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.735060:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743135:0:5873:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffffa0ceb1ca6600:5873] 0 exiting: rc = 1 00000100:00100000:3.0:1787579476.743285:0:5874:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffffa0ceb1ca7400:5874] 1 exiting: rc = 0 00000100:00100000:1.0:1787579476.743382:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743391:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743400:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743406:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743415:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743422:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743427:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743432:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743437:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743442:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743446:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743451:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743455:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743460:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743466:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743471:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743476:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743481:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743486:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743491:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743496:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743501:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743506:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743511:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743516:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743521:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743526:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743544:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743549:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743555:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743561:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743566:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743571:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743576:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743582:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743587:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743593:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743599:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743605:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743610:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743616:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743621:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743627:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743632:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743648:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743653:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743658:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743663:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743669:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743674:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743679:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743683:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743688:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743693:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743698:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743703:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743708:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743713:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743718:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743723:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743728:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743733:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743745:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.743751:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.744342:0:5875:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffffa0ceb1ca7e00:5875] 0 exiting: rc = 1 00000100:00100000:0.0:1787579476.744366:0:5876:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffffa0ceb1ca7600:5876] 1 exiting: rc = 0 00000100:00100000:1.0:1787579476.744492:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744498:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744504:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744510:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744515:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744520:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744524:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744529:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744534:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744540:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744546:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744551:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744556:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744562:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744568:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744574:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744579:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744585:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744591:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744597:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744602:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744608:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744614:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744619:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744625:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744630:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744645:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744651:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744657:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744662:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744668:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744673:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744678:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744693:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744698:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744705:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744711:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744716:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744722:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744727:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744733:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744738:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744743:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744749:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744754:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744760:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744764:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744769:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744774:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744780:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744785:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744790:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744795:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744799:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744804:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744808:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744813:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744818:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744824:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744830:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744835:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744840:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744846:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579476.744851:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.745390:0:5878:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffffa0ce983cfc00:5878] 1 exiting: rc = 0 00000100:00100000:3.0:1787579476.745474:0:5877:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffffa0ce983cfe00:5877] 0 exiting: rc = 1 00000100:00100000:0.0:1787579476.745618:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745624:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745629:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745645:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745650:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745655:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745659:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745664:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745669:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745674:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745678:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745683:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745688:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745693:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745698:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745703:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745707:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745713:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745717:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745723:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745728:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745733:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745747:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745752:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745756:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745761:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745766:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745770:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745775:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745779:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745784:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745788:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745793:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745798:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745802:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745806:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745811:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745816:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745820:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745824:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745829:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745834:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745839:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745844:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745848:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745853:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745858:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745862:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745867:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745872:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745876:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745881:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745886:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745891:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745896:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745901:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745905:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745917:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.745922:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.746174:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.746180:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.746184:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.746190:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579476.746194:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787579476.746683:0:5879:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffffa0ce87bfa200:5879] 0 exiting: rc = 1 00000100:00100000:2.0:1787579476.746830:0:5881:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffffa0ce87bfb200:5881] 2 exiting: rc = 0 00000100:00100000:0.0:1787579476.747366:0:5880:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffffa0ce87bfb800:5880] 1 exiting: rc = 0 00000100:00100000:2.0:1787579476.747466:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747473:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747480:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747487:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747493:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747500:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747507:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747513:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747519:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747525:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747531:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747537:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747553:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747559:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747565:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747572:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747578:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747584:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747590:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747596:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747601:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747607:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747622:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747630:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747645:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747651:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747657:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747663:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747669:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747676:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747682:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747688:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747693:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747699:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747706:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747712:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747718:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747724:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747730:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747737:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747742:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747747:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747753:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747759:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747765:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747771:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747791:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747803:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747808:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747814:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747820:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747825:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747830:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747836:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747842:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747848:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747854:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747860:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747865:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747871:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747877:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747883:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747889:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579476.747905:0:13097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787579476.751499:0:13097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787579476.751509:0:13097:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787579476.751514:0:13097:0:(genops.c:885:class_export_put()) final put ffffa0ce90458000/MDS_uuid 00000020:00000080:2.0:1787579476.751517:0:13097:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ce90458000/MDS_uuid for MDS 00000020:01000000:2.0:1787579476.751522:0:13097:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787579476.751622:0:13097:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00080000:3.0:1787579476.961079:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787579476.961086:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787579476.961090:0:479:0:(import.c:65:import_set_state_nolock()) ffffa0cebf6b2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787579476.961097:0:479:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 408 00000100:00080000:3.0:1787579476.961103:0:479:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787579476.961109:0:479:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa0cebf6b2800 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:3.0:1787579476.961129:0:479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0cebab68a80 x1874412616892928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787579476.961153:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787579476.961156:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787579476.961158:0:479:0:(import.c:65:import_set_state_nolock()) ffffa0ceb44b0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787579476.961162:0:479:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 408 00000100:00080000:3.0:1787579476.961164:0:479:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787579476.961167:0:479:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa0ceb44b0000 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:3.0:1787579476.961178:0:479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0cebab68700 x1874412616893056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787579476.961229:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3318:1874412616892928:0@lo:38:kworker.0 00000400:00000100:1.0:1787579476.961295:0:3318:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874412616892928 offset 0 length 520: 4 00000100:00100000:1.0:1787579476.961360:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3318:1874412616893056:0@lo:38:kworker.0 00000400:00000100:1.0:1787579476.961393:0:3318:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874412616893056 offset 0 length 520: 4 00000100:00100000:2.0:1787579476.961704:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616892800:0@lo:400:kworker.0 00000400:00000100:2.0:1787579476.961730:0:3321:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874412616892800 offset 0 length 224: 4 00010000:00010000:2.0:1787579477.411742:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579478.441146:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579479.460458:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787579480.351593:0:13254:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787579480.378048:0:13254:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787579480.378103:0:13254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79800/0xb72beeaffa1b6d4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6d53 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579480.378126:0:13254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79800/0xb72beeaffa1b6d4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6d53 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579480.378134:0:13254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79800/0xb72beeaffa1b6d4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb72beeaffa1b6d53 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579480.378141:0:13254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79800/0xb72beeaffa1b6d4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb72beeaffa1b6d53 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579480.378159:0:13254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787579480.378164:0:13254:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787579480.378184:0:13254:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787579480.378195:0:13254:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0cebab68a80 x1874412616892928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787579491 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579480.378583:0:13254:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787579480.378591:0:13254:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787579480.378597:0:13254:0:(import.c:65:import_set_state_nolock()) ffffa0cebf6b2800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787579480.378603:0:13254:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787579480.378608:0:13254:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0cebab68a80 x1874412616892928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787579491 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579480.378625:0:13254:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787579480.378629:0:13254:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:0.0:1787579480.379476:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3318:1874412616892928:0@lo:38:kworker.0 00010000:00010000:1.0:1787579480.381030:0:5853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787579480.381041:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79800/0xb72beeaffa1b6d4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xb72beeaffa1b6d53 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579480.381051:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb3f79800 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:1.0:1787579480.381055:0:5853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79800/0xb72beeaffa1b6d4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xb72beeaffa1b6d53 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579480.381064:0:5853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79800/0xb72beeaffa1b6d4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xb72beeaffa1b6d53 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787579480.381071:0:5853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79800/0xb72beeaffa1b6d4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xb72beeaffa1b6d53 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579480.381076:0:5853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787579480.381088:0:5853:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787579480.381091:0:5853:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787579480.381190:0:5853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79800/0xb72beeaffa1b6d4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xb72beeaffa1b6d53 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579480.381197:0:5853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787579480.381314:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616893184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787579480.381370:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579480.381446:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616893184 00000100:00100000:2.0:1787579480.381463:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616893184 00010000:00010000:1.0:1787579480.381482:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79800/0xb72beeaffa1b6d4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xb72beeaffa1b6d53 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579480.381492:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79800/0xb72beeaffa1b6d4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xb72beeaffa1b6d53 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579480.381506:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579480.381522:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579480.381525:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579480.381536:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787579480.381560:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3322:x1874412616893184:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787579480.381570:0:5851:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787579480 with bad export cookie 13198905572522158659 00010000:00010000:3.0:1787579480.382824:0:13254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79000/0xb72beeaffa1b6d5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6d61 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579480.382837:0:13254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79000/0xb72beeaffa1b6d5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6d61 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579480.382852:0:13254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79000/0xb72beeaffa1b6d5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb72beeaffa1b6d61 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579480.382857:0:13254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79000/0xb72beeaffa1b6d5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb72beeaffa1b6d61 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579480.382876:0:13254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787579480.382883:0:13254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b600/0xb72beeaffa1b6f8a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6f91 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579480.382888:0:13254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b600/0xb72beeaffa1b6f8a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6f91 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579480.382894:0:13254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b600/0xb72beeaffa1b6f8a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb72beeaffa1b6f91 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579480.382899:0:13254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b600/0xb72beeaffa1b6f8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb72beeaffa1b6f91 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579480.382909:0:13254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787579480.382912:0:13254:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787579480.382960:0:13254:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787579480.382964:0:13254:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787579480.382968:0:13254:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787579480.382974:0:13254:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787579480.382977:0:13254:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffffa0ceb485cd28) has no exports 00000020:00080000:3.0:1787579480.383000:0:13254:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffffa0ceb485cd28) has no exports 00010000:00010000:1.0:1787579480.383286:0:8476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787579480.383292:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79000/0xb72beeaffa1b6d5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb72beeaffa1b6d61 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579480.383299:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb3f79000 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:1.0:1787579480.383302:0:8476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79000/0xb72beeaffa1b6d5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb72beeaffa1b6d61 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579480.383310:0:8476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79000/0xb72beeaffa1b6d5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xb72beeaffa1b6d61 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787579480.383316:0:8476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79000/0xb72beeaffa1b6d5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xb72beeaffa1b6d61 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579480.383321:0:8476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787579480.383323:0:8476:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1787579480.383325:0:8476:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1787579480.383351:0:8476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79000/0xb72beeaffa1b6d5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb72beeaffa1b6d61 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579480.383357:0:8476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787579480.383373:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79000/0xb72beeaffa1b6d5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb72beeaffa1b6d61 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579480.383379:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79000/0xb72beeaffa1b6d5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb72beeaffa1b6d61 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579480.383390:0:8476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787579480.383393:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b600/0xb72beeaffa1b6f8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb72beeaffa1b6f91 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579480.383405:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148b600 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:1.0:1787579480.383407:0:8476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b600/0xb72beeaffa1b6f8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb72beeaffa1b6f91 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579480.383413:0:8476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b600/0xb72beeaffa1b6f8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb72beeaffa1b6f91 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787579480.383419:0:8476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b600/0xb72beeaffa1b6f8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb72beeaffa1b6f91 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579480.383424:0:8476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787579480.383426:0:8476:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787579480.383428:0:8476:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787579480.383441:0:8476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b600/0xb72beeaffa1b6f8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb72beeaffa1b6f91 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579480.383447:0:8476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787579480.383453:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b600/0xb72beeaffa1b6f8a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb72beeaffa1b6f91 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579480.383459:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b600/0xb72beeaffa1b6f8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb72beeaffa1b6f91 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579480.383468:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579480.383470:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579480.383472:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579480.383478:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579480.383490:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616893312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787579480.383540:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579480.383586:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787579480.383592:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616893440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787579480.383612:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1787579480.389449:0:13254:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0cebf1df0c0 - data ffffa0cebfc24798/ffffa0ceba838c00 00000020:01000000:3.0:1787579480.389611:0:13254:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0ce82c9dd20 - data ffffa0ce9273a360/ffffa0cebf38cc00 00000100:00100000:1.0:1787579480.390140:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616893312 00000100:00100000:1.0:1787579480.390151:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616893312 00000100:00100000:1.0:1787579480.390187:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616893440 00000100:00100000:1.0:1787579480.390190:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616893440 00000100:00100000:1.0:1787579480.390206:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787579480.390214:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb468ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3319:x1874412616893312:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787579480.390369:0:5850:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787579480 with bad export cookie 13198905572522158659 00000100:00100000:1.0:1787579480.390456:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb468ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3319:x1874412616893312:12345-0@lo:103:ldlm_bl.0 Request processed in 241us (6915us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787579480.390463:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787579480.390481:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787579480.390485:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4689500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3319:x1874412616893440:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787579480.390490:0:5850:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787579480 with bad export cookie 13198905572522158659 00000100:00080000:0.0:1787579480.390518:0:3319:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.153@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787579480.390524:0:3319:0:(import.c:65:import_set_state_nolock()) ffffa0ce90459800 MGS: changing import state from FULL to DISCONN 00000100:00100000:1.0:1787579480.390525:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4689500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3319:x1874412616893440:12345-0@lo:103:ldlm_bl.0 Request processed in 37us (6911us total) trans 0 rc -107/-107 00000100:02020000:0.0:1787579480.390531:0:3319:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.153@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:1.0:1787579480.390536:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787579480.421347:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3322:x1874412616893184:12345-0@lo:103:ldlm_bl.0 Request processed in 39788us (39963us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787579480.421366:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787579480.421395:0:3322:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.153@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787579480.426833:0:3319:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.153@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1787579480.426838:0:3319:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787579480.426847:0:3319:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0cebab6b100 x1874412616892800/t0(0) o400->MGC192.168.206.153@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787579492 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579480.426867:0:3319:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0ceb4688380 x1874412616893184/t0(0) o103->MGC192.168.206.153@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787579496 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579480.426874:0:3319:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0ceb468b800 x1874412616893312/t0(0) o103->MGC192.168.206.153@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787579496 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579480.426879:0:3319:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0ceb468a300 x1874412616893440/t0(0) o103->MGC192.168.206.153@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787579496 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787579480.426909:0:3322:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffffa0ce90459800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1787579480.427054:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3322:1874412616893184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787579480.427436:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3321:1874412616892800:0@lo:400:kworker.0 10000000:01000000:0.0:1787579480.427512:0:3319:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787579480.427516:0:3319:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787579480.427517:0:3319:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787579480.427520:0:3319:0:(import.c:65:import_set_state_nolock()) ffffa0ce90459800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787579480.427525:0:3319:0:(import.c:510:import_select_connection()) MGC192.168.206.153@tcp: connect to NID 0@lo last attempt 189 00000100:00080000:0.0:1787579480.427550:0:3319:0:(import.c:624:import_select_connection()) MGC192.168.206.153@tcp: import ffffa0ce90459800 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:1.0:1787579480.427648:0:3319:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ceb4688380 x1874412616893568/t0(0) o250->MGC192.168.206.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787579480.427704:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3318:1874412616893568:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1787579480.427747:0:3318:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874412616893568 offset 0 length 520: 4 00000100:00100000:1.0:1787579480.427803:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616893440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787579480.427814:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3319:1874412616893312:0@lo:103:ldlm_bl.0 00100000:10000000:2.0:1787579480.443568:0:13254:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787579480.465841:0:13254:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6b77 00000020:00000080:0.0:1787579480.465850:0:13254:0:(genops.c:885:class_export_put()) final put ffffa0cebf3e9000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787579480.465876:0:13254:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0ce84eda800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787579480.465880:0:13254:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0ce84eda800 2 00000020:01000004:0.0:1787579480.465883:0:13254:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa0ce84eda800 from lustre-OST0000 00000020:00000080:0.0:1787579480.465907:0:13254:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787579480.465915:0:13254:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787579480.465918:0:13254:0:(genops.c:885:class_export_put()) final put ffffa0ceb313c000/lustre-OST0000_UUID 00000020:00000080:0.0:1787579480.465921:0:13254:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ceb313c000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787579480.465951:0:13254:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787579480.465986:0:13254:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787579480.465990:0:13254:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787579480.465993:0:13254:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787579480.465997:0:13254:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787579480.466003:0:13254:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffffa0cebf6b5800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787579480.466009:0:13254:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffffa0ceb591b370) has exports, disconnecting them 00000020:00080000:0.0:1787579480.466014:0:13254:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffffa0cebf6b5800), last request at 1787579269 00000020:00000080:0.0:1787579480.466018:0:13254:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6ba1 00000020:00080000:0.0:1787579480.466027:0:13254:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0cebf6b5800): rc 0 00000020:00000080:0.0:1787579480.466031:0:13254:0:(genops.c:885:class_export_put()) final put ffffa0cebf6b5800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787579480.466880:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffffa0cebf3e9000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787579480.466894:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffffa0cebf6b5800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787579480.484248:0:13254:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787579480.484256:0:13254:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787579480.484260:0:13254:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787579480.484267:0:13254:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787579480.484464:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0cebf6b2800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787579480.484553:0:13254:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787579480.484561:0:13254:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1787579480.484575:0:13254:0:(genops.c:885:class_export_put()) final put ffffa0cebc4ab800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1787579480.484579:0:13254:0:(genops.c:844:class_export_destroy()) destroying export ffffa0cebc4ab800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1787579480.484586:0:13254:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1787579480.484646:0:13254:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0ce84eda800 1 00000020:00000080:0.0:1787579480.484651:0:13254:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6b31 00000020:00000080:0.0:1787579480.484657:0:13254:0:(genops.c:885:class_export_put()) final put ffffa0cec1195800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787579480.484671:0:13254:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787579480.484676:0:13254:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787579480.484681:0:13254:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787579480.484685:0:13254:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffffa0ceb591cd28) has no exports 00000020:00000080:3.0:1787579480.484744:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffffa0cec1195800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00010000:00010000:2.0:1787579480.486226:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787579480.498053:0:13254:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787579480.498069:0:13254:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787579480.498075:0:13254:0:(genops.c:885:class_export_put()) final put ffffa0ceb5968000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787579480.498155:0:13254:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ceb5968000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787579480.498162:0:13254:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787579480.498289:0:13254:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa0ce84ede800 00000020:02000400:2.0:1787579480.498332:0:13254:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1787579481.504393:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787579482.081227:0:12671:0:(pinger.c:229:ptlrpc_pinger_process_import()) 58d0ce6f-950d-4003-ac33-0f50e03ceaf8->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787579482.081236:0:12671:0:(pinger.c:247:ptlrpc_pinger_process_import()) 58d0ce6f-950d-4003-ac33-0f50e03ceaf8->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787579482.081239:0:12671:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787579482.081243:0:12671:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787579482.528181:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579483.555623:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787579484.542552:0:13405:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787579484.574430:0:13405:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1787579484.574524:0:13405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8152fe00/0xb72beeaffa1b6d30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6d37 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579484.574542:0:13405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8152fe00/0xb72beeaffa1b6d30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6d37 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579484.574550:0:13405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8152fe00/0xb72beeaffa1b6d30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb72beeaffa1b6d37 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579484.574557:0:13405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.153@tcp lock: ffffa0ce8152fe00/0xb72beeaffa1b6d30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb72beeaffa1b6d37 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579484.574578:0:13405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787579484.574585:0:13405:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787579484.574622:0:13405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787579484.574637:0:13405:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0cebab68700 x1874412616893056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787579491 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579484.574664:0:13405:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787579484.574673:0:13405:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787579484.574681:0:13405:0:(import.c:65:import_set_state_nolock()) ffffa0ceb44b0000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787579484.574703:0:13405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787579484.574708:0:13405:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0cebab68700 x1874412616893056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787579491 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579484.574716:0:13405:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787579484.574720:0:13405:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:0.0:1787579484.576352:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3318:1874412616893056:0@lo:38:kworker.0 00010000:00010000:2.0:1787579484.577466:0:8475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787579484.577481:0:8475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce8152fe00/0xb72beeaffa1b6d30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb72beeaffa1b6d37 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579484.577494:0:8475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8152fe00 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:2.0:1787579484.577499:0:8475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8152fe00/0xb72beeaffa1b6d30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb72beeaffa1b6d37 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579484.577511:0:8475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce8152fe00/0xb72beeaffa1b6d30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb72beeaffa1b6d37 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787579484.577519:0:8475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8152fe00/0xb72beeaffa1b6d30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb72beeaffa1b6d37 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579484.577552:0:8475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787579484.577555:0:8475:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787579484.577560:0:8475:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787579484.577583:0:8475:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0ce90459800 00010000:00010000:2.0:1787579484.577587:0:8475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce8152fe00/0xb72beeaffa1b6d30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb72beeaffa1b6d37 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579484.577606:0:8475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce8152fe00/0xb72beeaffa1b6d30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb72beeaffa1b6d37 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579484.577623:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579484.577625:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579484.577627:0:8475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579484.578783:0:13405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79c00/0xb72beeaffa1b6d3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6d45 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579484.578800:0:13405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79c00/0xb72beeaffa1b6d3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6d45 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579484.578807:0:13405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79c00/0xb72beeaffa1b6d3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb72beeaffa1b6d45 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579484.578814:0:13405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79c00/0xb72beeaffa1b6d3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb72beeaffa1b6d45 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579484.579133:0:5853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787579484.579141:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79c00/0xb72beeaffa1b6d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb72beeaffa1b6d45 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579484.579150:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb3f79c00 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:2.0:1787579484.579153:0:5853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79c00/0xb72beeaffa1b6d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb72beeaffa1b6d45 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579484.579163:0:5853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79c00/0xb72beeaffa1b6d3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb72beeaffa1b6d45 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787579484.579170:0:5853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79c00/0xb72beeaffa1b6d3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb72beeaffa1b6d45 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579484.579188:0:5853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787579484.579191:0:5853:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1787579484.579217:0:5853:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0ce90459800 00010000:00010000:2.0:1787579484.579222:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79c00/0xb72beeaffa1b6d3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb72beeaffa1b6d45 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579484.579231:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579484.579233:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579484.579235:0:5853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579484.579430:0:13405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787579484.579438:0:13405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ceb3f79c00/0xb72beeaffa1b6d3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb72beeaffa1b6d45 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579484.579456:0:13405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba319800/0xb72beeaffa1b6f75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b6f7c expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579484.579462:0:13405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba319800/0xb72beeaffa1b6f75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b6f7c expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579484.579468:0:13405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba319800/0xb72beeaffa1b6f75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb72beeaffa1b6f7c expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579484.579474:0:13405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.153@tcp lock: ffffa0ceba319800/0xb72beeaffa1b6f75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb72beeaffa1b6f7c expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579484.579515:0:8476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787579484.579521:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ceba319800/0xb72beeaffa1b6f75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb72beeaffa1b6f7c expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579484.579527:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba319800 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:2.0:1787579484.579530:0:8476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ceba319800/0xb72beeaffa1b6f75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb72beeaffa1b6f7c expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579484.579538:0:8476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ceba319800/0xb72beeaffa1b6f75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb72beeaffa1b6f7c expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787579484.579545:0:8476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ceba319800/0xb72beeaffa1b6f75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb72beeaffa1b6f7c expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579484.579550:0:8476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787579484.579552:0:8476:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1787579484.579557:0:8476:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0ce90459800 00010000:00010000:2.0:1787579484.579560:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ceba319800/0xb72beeaffa1b6f75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb72beeaffa1b6f7c expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579484.579568:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579484.579569:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579484.579571:0:8476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579484.579637:0:13405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787579484.579642:0:13405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ceba319800/0xb72beeaffa1b6f75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb72beeaffa1b6f7c expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579484.579657:0:13405:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1787579484.579662:0:13405:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1787579484.579665:0:13405:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1787579484.579702:0:13405:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1787579484.579707:0:13405:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1787579484.579713:0:13405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787579484.579720:0:13405:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787579484.579725:0:13405:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffffa0ce8674b370) has no exports 00000020:00080000:1.0:1787579484.579754:0:13405:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffffa0ce8674b370) has no exports 00010000:00010000:2.0:1787579484.582765:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787579484.582982:0:13405:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0cebf826420 - data ffffa0cebfcff0d8/ffffa0ceb3d41800 00000020:01000000:1.0:1787579484.583157:0:13405:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0ce91841240 - data ffffa0ce8f6316c0/ffffa0ceb3d46800 00100000:10000000:2.0:1787579484.611034:0:13405:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787579484.646906:0:13405:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6c65 00000020:00000080:1.0:1787579484.646918:0:13405:0:(genops.c:885:class_export_put()) final put ffffa0cebf862800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1787579484.648682:0:13405:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0ceb3138000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1787579484.648693:0:13405:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0ceb3138000 2 00000020:01000004:1.0:1787579484.648697:0:13405:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa0ceb3138000 from lustre-OST0001 00000020:00000080:1.0:1787579484.648742:0:13405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787579484.648756:0:13405:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1787579484.648761:0:13405:0:(genops.c:885:class_export_put()) final put ffffa0cebf866800/lustre-OST0001_UUID 00000020:00000080:1.0:1787579484.648765:0:13405:0:(genops.c:844:class_export_destroy()) destroying export ffffa0cebf866800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1787579484.648777:0:13405:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1787579484.648915:0:13405:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 58d0ce6f-950d-4003-ac33-0f50e03ceaf8->MGS 00010000:00010000:1.0:1787579484.648953:0:13405:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a400/0xb72beeaffa1b6b54 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb72beeaffa1b6b5b expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787579484.648969:0:13405:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a400/0xb72beeaffa1b6b54 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb72beeaffa1b6b5b expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579484.648993:0:13405:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1787579484.648996:0:13405:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1787579484.649000:0:13405:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1787579484.649019:0:13405:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0ce90459800 00010000:00010000:1.0:1787579484.649023:0:13405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce8148a400/0xb72beeaffa1b6b54 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb72beeaffa1b6b5b expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579484.649042:0:13405:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b200/0xb72beeaffa1b6d84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb72beeaffa1b6d8b expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787579484.649050:0:13405:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b200/0xb72beeaffa1b6d84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb72beeaffa1b6d8b expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579484.649055:0:13405:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787579484.649057:0:13405:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1787579484.649059:0:13405:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1787579484.649068:0:13405:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0ce90459800 00010000:00010000:1.0:1787579484.649071:0:13405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b200/0xb72beeaffa1b6d84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb72beeaffa1b6d8b expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787579484.649089:0:13405:0:(import.c:65:import_set_state_nolock()) ffffa0ce90459800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1787579484.649093:0:13405:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787579484.649095:0:13405:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787579484.649097:0:13405:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787579484.649102:0:13405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787579484.649116:0:13405:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0ceb4688380 x1874412616893568/t0(0) o250->MGC192.168.206.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787579490 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787579484.649134:0:13405:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787579484.649138:0:13405:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000020:00000080:2.0:1787579484.649376:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0cebf862800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1787579484.649864:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:58d0ce6f-950d-4003-ac33-0f50e03ceaf8:3318:1874412616893568:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:1.0:1787579484.650660:0:13405:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787579484.650690:0:13405:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6a35 00000020:00000080:1.0:1787579484.650701:0:13405:0:(genops.c:885:class_export_put()) final put ffffa0ce9045d000/58d0ce6f-950d-4003-ac33-0f50e03ceaf8 00000020:01000000:1.0:1787579484.650713:0:13405:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.153@tcp (flags='') 00000020:00000080:1.0:1787579484.650719:0:13405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787579484.650728:0:13405:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.153@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787579484.650732:0:13405:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffffa0ce98720000) has no exports 00000020:00000080:2.0:1787579484.650805:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ce9045d000/58d0ce6f-950d-4003-ac33-0f50e03ceaf8 for MGC192.168.206.153@tcp 10000000:01000000:0.0:1787579484.650870:0:5863:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787579484.651010:0:13405:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.153@tcp: client import never connected 00000100:00080000:1.0:1787579484.651015:0:13405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787579484.651018:0:13405:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787579484.651021:0:13405:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787579484.651023:0:13405:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787579484.651082:0:13405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787579484.651089:0:13405:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.153@tcp (uuid 58d0ce6f-950d-4003-ac33-0f50e03ceaf8) 00000020:01000000:1.0:1787579484.651097:0:13405:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787579484.651100:0:13405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787579484.651104:0:13405:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787579484.651111:0:13405:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffffa0ceb44b4800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:2.0:1787579484.651299:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0ce90459800 for MGC192.168.206.153@tcp 00000020:00000080:2.0:1787579484.651307:0:36:0:(genops.c:885:class_export_put()) final put ffffa0ce9045b800/58d0ce6f-950d-4003-ac33-0f50e03ceaf8 00000020:00000080:2.0:1787579484.651310:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ce9045b800/58d0ce6f-950d-4003-ac33-0f50e03ceaf8 for MGC192.168.206.153@tcp 00000020:01000000:2.0:1787579484.651316:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.153@tcp (58d0ce6f-950d-4003-ac33-0f50e03ceaf8) 00000020:00080000:1.0:1787579484.651811:0:13405:0:(genops.c:1553:class_disconnect_exports()) OBD device 17 (ffffa0ceb44a8000) has exports, disconnecting them 00000020:00080000:1.0:1787579484.651820:0:13405:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffffa0ceb44b4800), last request at 1787579287 00000020:00000080:1.0:1787579484.651826:0:13405:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6c8f 00000020:00080000:1.0:1787579484.651843:0:13405:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0ceb44b4800): rc 0 00000020:00000080:1.0:1787579484.651847:0:13405:0:(genops.c:885:class_export_put()) final put ffffa0ceb44b4800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787579484.654327:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ceb44b4800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787579484.664247:0:13405:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787579484.664261:0:13405:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787579484.664266:0:13405:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787579484.664276:0:13405:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787579484.664776:0:8475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:2.0:1787579484.664916:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0ceb44b0000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1787579484.665465:0:5853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1787579484.665679:0:8476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:2.0:1787579484.665826:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:2.0:1787579484.668816:0:5849:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffffa0ce98717000:5849] 1 exiting: rc = 0 00000100:00100000:2.0:1787579484.668962:0:5848:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffffa0ce98716a00:5848] 0 exiting: rc = 1 00000100:00100000:0.0:1787579484.669059:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787579484.669867:0:8477:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffffa0ce86627400:8477] 3 exiting: rc = 0 00000100:00100000:2.0:1787579484.669989:0:5851:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffffa0ce98717400:5851] 1 exiting: rc = 0 00000100:00100000:2.0:1787579484.684392:0:5852:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffffa0ce98717a00:5852] 2 exiting: rc = 0 00000100:00100000:0.0:1787579484.692133:0:5850:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffffa0ce98716c00:5850] 0 exiting: rc = 1 00000100:00100000:0.0:1787579484.696755:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.696770:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.696777:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.696784:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.696791:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.696798:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.696808:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.696815:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.696822:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.696829:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.696835:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.696867:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.696873:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.696880:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.696886:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.696893:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.696901:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.696907:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.696913:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.696920:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.696951:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.696959:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.696965:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.696971:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.696978:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.696985:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.696991:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.696996:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697003:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697010:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697017:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697023:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697029:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697034:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697040:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697046:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697052:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697070:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697076:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697084:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697090:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697096:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697103:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697472:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697480:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697486:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697501:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697507:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697513:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697519:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697524:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697530:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697535:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697541:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697546:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697551:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.697557:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.698244:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.698252:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.698258:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.698264:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.698535:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.698544:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.698550:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787579484.720024:0:13405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787579484.720047:0:13405:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1787579484.720067:0:13405:0:(genops.c:885:class_export_put()) final put ffffa0cebf867800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1787579484.720074:0:13405:0:(genops.c:844:class_export_destroy()) destroying export ffffa0cebf867800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1787579484.720083:0:13405:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1787579484.720199:0:13405:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0ceb3138000 1 00000020:00000080:0.0:1787579484.720207:0:13405:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb72beeaffa1b6c11 00000020:00000080:0.0:1787579484.720216:0:13405:0:(genops.c:885:class_export_put()) final put ffffa0cebf6b1800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787579484.720238:0:13405:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787579484.720244:0:13405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787579484.720250:0:13405:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787579484.720255:0:13405:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffffa0cec1bf0000) has no exports 00000020:00000080:2.0:1787579484.721516:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0cebf6b1800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787579484.780744:0:13405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787579484.780766:0:13405:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1787579484.780774:0:13405:0:(genops.c:885:class_export_put()) final put ffffa0ceb313c800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1787579484.780795:0:13405:0:(genops.c:844:class_export_destroy()) destroying export ffffa0ceb313c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787579484.780807:0:13405:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1787579484.781019:0:13405:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa0ceb3138800 00000020:01000000:0.0:1787579484.781043:0:13405:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1787579484.781048:0:13405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787579484.781053:0:13405:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787579484.781058:0:13405:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffffa0ce86748000) has no exports 00000020:00000080:0.0:1787579484.781086:0:13405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787579484.781091:0:13405:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1787579484.781094:0:13405:0:(genops.c:885:class_export_put()) final put ffffa0cec1191000/OSS_uuid 00000020:00000080:0.0:1787579484.781097:0:13405:0:(genops.c:844:class_export_destroy()) destroying export ffffa0cec1191000/OSS_uuid for OSS 00000020:01000000:0.0:1787579484.781102:0:13405:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1787579484.781677:0:5862:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787579484.781967:0:6710:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffffa0ce85701600:6710] 0 exiting: rc = 1 00000100:00100000:2.0:1787579484.782034:0:6711:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffffa0ceb3f02600:6711] 1 exiting: rc = 0 00000100:00100000:0.0:1787579484.783971:0:7660:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffffa0ceb5946000:7660] 3 exiting: rc = 0 00000100:00100000:1.0:1787579484.786677:0:6712:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffffa0ceb402f200:6712] 2 exiting: rc = 0 00000100:00100000:0.0:1787579484.787268:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787293:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787301:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787309:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787317:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787325:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787336:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787344:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787350:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787356:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787373:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787379:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787384:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787389:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787395:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787400:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787405:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787411:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787418:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787423:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787429:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787542:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787550:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787556:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787564:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787570:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787579:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787585:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787598:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787604:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787668:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787675:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787680:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787689:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787695:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787700:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787705:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787710:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787716:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787723:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787730:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787736:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787742:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787747:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787753:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787759:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787765:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787771:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787777:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787782:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787788:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787853:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787864:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787870:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787880:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787888:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787904:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787914:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787920:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787949:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.787956:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.788011:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.788065:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.788305:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.796554:0:6714:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffffa0ceb402ec00:6714] 1 exiting: rc = 0 00000100:00100000:2.0:1787579484.800546:0:6713:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffffa0ceb402ee00:6713] 0 exiting: rc = 1 00000100:00100000:2.0:1787579484.800676:0:7952:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffffa0cebf915000:7952] 2 exiting: rc = 0 00000100:00100000:0.0:1787579484.801018:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801033:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801042:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801064:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801076:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801085:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801094:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801103:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801120:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801127:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801133:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801139:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801145:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801150:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801155:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801160:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801165:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801170:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801182:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801187:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801193:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801198:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801208:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801214:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801220:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801225:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801242:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801247:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801252:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801257:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801261:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801266:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801271:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801276:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801280:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801285:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801290:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801294:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801300:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801306:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801335:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801341:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801346:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801352:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801358:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801363:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801378:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801384:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801390:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801396:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801401:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801407:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801413:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801419:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801425:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801430:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801436:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801442:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801448:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801460:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801467:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801478:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801484:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.801489:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.803557:0:6716:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffffa0ceb3f7fe00:6716] 1 exiting: rc = 0 00000100:00100000:0.0:1787579484.805864:0:6715:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffffa0ceb3f03200:6715] 0 exiting: rc = 1 00000100:00100000:2.0:1787579484.863785:0:6717:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffffa0ce9206a400:6717] 2 exiting: rc = 0 00000100:00100000:0.0:1787579484.864562:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864573:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864582:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864589:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864607:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864613:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864619:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864626:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864632:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864639:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864645:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864651:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864658:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864664:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864671:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864677:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864683:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864689:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864695:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864702:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864708:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864714:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864721:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864728:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864735:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864741:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864769:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864776:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864782:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864789:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864811:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864817:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864823:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864830:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864837:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864843:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864849:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864854:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864859:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864866:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864872:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864879:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864886:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864892:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864898:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864904:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864910:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864915:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864921:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864944:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864951:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864957:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864963:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864969:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864975:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864982:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864988:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.864994:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.865001:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.865006:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.865014:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.865021:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.865028:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.865043:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.908777:0:6719:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffffa0ce85701e00:6719] 1 exiting: rc = 0 00000100:00100000:1.0:1787579484.909803:0:6718:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffffa0ce92044c00:6718] 0 exiting: rc = 1 00000100:00100000:0.0:1787579484.909909:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.909917:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.909923:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.909946:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.909953:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.909958:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.909964:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.909972:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.909977:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.909984:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.909990:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.909996:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910002:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910007:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910013:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910019:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910025:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910030:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910035:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910040:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910046:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910052:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910058:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910064:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910069:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910074:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910080:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910085:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910090:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910096:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910102:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910540:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910551:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910557:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910563:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910586:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910632:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910639:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910646:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910652:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910658:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910664:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910670:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910674:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910679:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910684:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910689:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910694:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910699:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910704:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910708:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910713:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910718:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910723:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910728:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910735:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910740:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910745:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910751:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910756:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910762:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910767:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910773:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.910779:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787579484.913302:0:6720:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffffa0cea15e0c00:6720] 0 exiting: rc = 1 00000100:00100000:0.0:1787579484.913415:0:6721:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffffa0ce92045800:6721] 1 exiting: rc = 0 00000100:00100000:1.0:1787579484.913587:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913664:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913672:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913679:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913699:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913711:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913720:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913750:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913763:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913770:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913777:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913784:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913794:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913807:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913817:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913824:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913850:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913858:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913865:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913872:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913878:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913884:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913891:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913897:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913904:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913911:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913922:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913950:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913974:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913982:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913989:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.913996:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914004:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914010:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914016:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914023:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914029:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914035:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914041:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914048:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914083:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914091:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914105:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914111:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914119:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914125:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914131:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914137:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914143:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914150:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914157:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914164:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914186:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914193:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914200:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914207:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914218:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914228:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914234:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914240:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914248:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914255:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914262:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787579484.914268:0:13405:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1787579484.929915:0:13405:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787579503.046417:0:14020:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg653-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787579512.539419:0:14482:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787579512.539425:0:14482:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787579512.539544:0:14482:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa0ce91c07000 00000020:01000004:2.0:1787579512.539558:0:14482:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787579512.539576:0:14482:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787579512.539716:0:14482:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffffa0ceb3d58000) 00000020:00000080:2.0:1787579512.539734:0:14482:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787579512.561615:0:14482:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787579512.564135:0:14482:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1787579512.564655:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:1.0:1787579512.564755:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:1.0:1787579512.564921:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:1.0:1787579512.565100:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:1.0:1787579512.565413:0:14482:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1787579512.565499:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:1.0:1787579512.565593:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:1.0:1787579512.565911:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:1.0:1787579512.568069:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 471: rc = 0 00100000:10000000:1.0:1787579512.568173:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 471: rc = 0 00100000:10000000:1.0:1787579512.568676:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 222: rc = 0 00100000:10000000:1.0:1787579512.570100:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 222: rc = 0 00100000:10000000:1.0:1787579512.571562:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 222: rc = 0 00100000:10000000:1.0:1787579512.571880:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 222: rc = 0 00100000:10000000:1.0:1787579512.572349:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 222: rc = 0 00100000:10000000:1.0:1787579512.572637:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 222: rc = 0 00100000:10000000:1.0:1787579512.573001:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 222: rc = 0 00100000:10000000:1.0:1787579512.573480:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 222: rc = 0 00100000:10000000:1.0:1787579512.573695:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 222: rc = 0 00100000:10000000:1.0:1787579512.574080:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 222: rc = 0 00100000:10000000:1.0:1787579512.574485:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 222: rc = 0 00100000:10000000:1.0:1787579512.574722:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 222: rc = 0 00100000:10000000:1.0:1787579512.575254:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 241: rc = 0 00100000:10000000:1.0:1787579512.575655:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 241: rc = 0 00100000:10000000:1.0:1787579512.577919:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 241: rc = 0 00100000:10000000:1.0:1787579512.578405:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 241: rc = 0 00100000:10000000:1.0:1787579512.578675:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 241: rc = 0 00100000:10000000:0.0:1787579512.582515:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 241: rc = 0 00100000:10000000:0.0:1787579512.583412:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 241: rc = 0 00100000:10000000:0.0:1787579512.583747:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 241: rc = 0 00100000:10000000:0.0:1787579512.584917:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 241: rc = 0 00100000:10000000:0.0:1787579512.585196:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 241: rc = 0 00100000:10000000:0.0:1787579512.585636:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 241: rc = 0 00100000:10000000:0.0:1787579512.586459:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 241: rc = 0 00100000:10000000:0.0:1787579512.586710:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 241: rc = 0 00100000:10000000:2.0:1787579512.587341:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 241: rc = 0 00100000:10000000:2.0:1787579512.587598:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 241: rc = 0 00100000:10000000:2.0:1787579512.588357:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 241: rc = 0 00100000:10000000:2.0:1787579512.588634:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 241: rc = 0 00100000:10000000:2.0:1787579512.588886:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 241: rc = 0 00100000:10000000:2.0:1787579512.589147:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 241: rc = 0 00100000:10000000:2.0:1787579512.589378:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 241: rc = 0 00100000:10000000:2.0:1787579512.589649:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 241: rc = 0 00100000:10000000:2.0:1787579512.589883:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 241: rc = 0 00100000:10000000:2.0:1787579512.590159:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 241: rc = 0 00100000:10000000:2.0:1787579512.590377:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 241: rc = 0 00100000:10000000:2.0:1787579512.591664:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 241: rc = 0 00100000:10000000:2.0:1787579512.597969:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 241: rc = 0 00100000:10000000:2.0:1787579512.598275:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 241: rc = 0 00100000:10000000:2.0:1787579512.598529:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 241: rc = 0 00100000:10000000:2.0:1787579512.598788:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 241: rc = 0 00100000:10000000:2.0:1787579512.599069:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 241: rc = 0 00100000:10000000:2.0:1787579512.599300:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 241: rc = 0 00100000:10000000:2.0:1787579512.599547:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 241: rc = 0 00100000:10000000:2.0:1787579512.599887:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 236: rc = 0 00100000:10000000:2.0:1787579512.601671:0:14482:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1787579512.601846:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 668: rc = 0 00100000:10000000:2.0:1787579512.602172:0:14482:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1787579512.602258:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 668: rc = 0 00100000:10000000:2.0:1787579512.602574:0:14482:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1787579512.602639:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 668: rc = 0 00100000:10000000:2.0:1787579512.603062:0:14482:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1787579512.603128:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 472: rc = 0 00100000:10000000:2.0:1787579512.607084:0:14482:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1787579512.607180:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 472: rc = 0 00100000:10000000:2.0:1787579512.607501:0:14482:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1787579512.607569:0:14482:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 472: rc = 0 00000020:00000080:2.0:1787579512.608458:0:14482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787579512.608467:0:14482:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787579512.608478:0:14482:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb72beeaffa1b7d28 00000020:01000004:2.0:1787579512.608486:0:14482:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787579512.608490:0:14482:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787579512.608495:0:14482:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0ce91c07000 from MGS 00000020:01000004:2.0:1787579512.608498:0:14482:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787579512.608509:0:14482:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffffa0ceb3d5cd28) 00000020:00000080:2.0:1787579512.608521:0:14482:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787579512.608574:0:14482:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0ce91c07000 from MGS, refs=2 00080000:01000000:2.0:1787579512.608579:0:14482:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787579512.608584:0:14482:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb72beeaffa1b7d36 00000100:00100000:2.0:1787579512.608681:0:14482:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787579512.608816:0:14482:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787579512.608821:0:14482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787579512.610273:0:14482:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787579512.610283:0:14482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787579512.611051:0:14482:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787579512.611554:0:14482:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787579512.611561:0:14482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787579512.612410:0:14482:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787579512.612418:0:14482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787579512.613152:0:14482:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787579512.613160:0:14482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787579512.613900:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579512.613903:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579512.613905:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579512.614214:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579512.614217:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579512.614219:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579512.614979:0:14482:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787579512.626318:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787579512.644073:0:14482:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787579512.644091:0:14482:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787579512.644093:0:14482:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787579512.646913:0:14491:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787579512.647337:0:14482:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787579512.647456:0:14482:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787579512.647897:0:14482:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787579512.648241:0:14482:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787579512.648398:0:14482:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787579512.648404:0:14482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787579512.670757:0:14482:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787579512.670773:0:14482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787579512.671143:0:14482:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787579512.671150:0:14482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787579512.671785:0:14482:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787579512.671807:0:14482:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.153@tcp' 00000020:01000004:0.0:1787579512.671809:0:14482:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787579512.671838:0:14482:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.153@tcp (typ=mgc) 00000020:00000080:0.0:1787579512.671849:0:14482:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.153@tcp (ffffa0ceb485cd28) 00000020:00000080:0.0:1787579512.671865:0:14482:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787579512.671957:0:14482:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0cec175f000@MGC192.168.206.153@tcp: add connection 192.168.206.153@tcp at head 00010000:00010000:0.0:1787579512.672091:0:14482:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.153@tcp-0 is initialized 00000040:01000000:0.0:1787579512.672096:0:14482:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.153@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787579512.673704:0:14496:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1787579512.675636:0:14497:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787579512.675719:0:14482:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.153@tcp (uuid 6514e2d9-be54-4793-9feb-dcbd6b926656) 00000020:00000080:2.0:1787579512.675739:0:14482:0:(genops.c:1385:class_connect()) connect: client 6514e2d9-be54-4793-9feb-dcbd6b926656, cookie 0xb72beeaffa1b7d44 00000100:00080000:2.0:1787579512.675750:0:14482:0:(import.c:510:import_select_connection()) MGC192.168.206.153@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787579512.675756:0:14482:0:(import.c:624:import_select_connection()) MGC192.168.206.153@tcp: import ffffa0cec175f000 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:2.0:1787579512.675785:0:14482:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ceb480d180 x1874412616893696/t0(0) o250->MGC192.168.206.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787579512.675811:0:14482:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6514e2d9-be54-4793-9feb-dcbd6b926656->MGS 00000020:01000004:2.0:1787579512.675838:0:14482:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787579512.675843:0:14482:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787579512.675854:0:14482:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffffa0ceb3d5b370) 00000020:00000080:2.0:1787579512.675865:0:14482:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787579512.677335:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6514e2d9-be54-4793-9feb-dcbd6b926656:3318:1874412616893696:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787579512.677405:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579512.687356:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616893696 00000100:00100000:1.0:1787579512.687369:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616893696 00000100:00100000:1.0:1787579512.687407:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787579512.687415:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf38f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3318:x1874412616893696:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1787579512.687448:0:14492:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 6514e2d9-be54-4793-9feb-dcbd6b926656@0@lo t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:1.0:1787579512.687476:0:14492:0:(genops.c:1385:class_connect()) connect: client 6514e2d9-be54-4793-9feb-dcbd6b926656, cookie 0xb72beeaffa1b7d52 00000100:00080000:1.0:1787579512.687595:0:14492:0:(import.c:65:import_set_state_nolock()) ffffa0ce9877d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787579512.687682:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf38f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+5:3318:x1874412616893696:12345-0@lo:250:mount.lustre.0 Request processed in 266us (10276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579512.687689:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787579512.689645:0:3318:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.153@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787579512.689659:0:3318:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.153@tcp: connect to target with instance 0 00000100:00080000:3.0:1787579512.689668:0:3318:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.153@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787579512.689673:0:3318:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787579512.689677:0:3318:0:(import.c:65:import_set_state_nolock()) ffffa0cec175f000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787579512.689680:0:3318:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787579512.689702:0:3318:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787579512.689709:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6514e2d9-be54-4793-9feb-dcbd6b926656:3318:1874412616893696:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787579512.705904:0:14482:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787579512.706119:0:14482:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787579512.706137:0:14482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787579512.718350:0:14482:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787579512.718407:0:14482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787579512.733233:0:14482:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787579512.733245:0:14482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787579512.738672:0:14482:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787579512.739018:0:14482:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787579512.739031:0:14482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787579512.741783:0:14482:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787579512.741877:0:14482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787579512.862569:0:14482:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787579512.862823:0:14482:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787579512.862830:0:14482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787579512.873334:0:14482:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787579512.873347:0:14482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787579512.878848:0:14482:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787579512.879045:0:14482:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787579512.879051:0:14482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787579512.883042:0:14482:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787579512.883054:0:14482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787579512.885194:0:14482:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787579512.885386:0:14482:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787579512.885391:0:14482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787579512.891081:0:14482:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787579512.891100:0:14482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787579512.891704:0:14482:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787579512.891888:0:14482:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787579512.891893:0:14482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787579512.892428:0:14482:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787579512.892434:0:14482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787579512.934275:0:14482:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787579512.948060:0:14482:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787579512.948079:0:14482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787579512.949820:0:14482:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787579512.949831:0:14482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787579512.951751:0:14482:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787579512.951762:0:14482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787579512.953635:0:14482:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787579512.953658:0:14482:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787579512.953664:0:14482:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.153@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787579512.953784:0:14482:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.153@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787579512.953828:0:14482:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.153@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787579512.953832:0:14482:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787579512.953834:0:14482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787579512.953835:0:14482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787579512.953837:0:14482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787579512.953838:0:14482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787579512.953839:0:14482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787579512.953840:0:14482:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787579512.953842:0:14482:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787579512.953844:0:14482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787579512.953845:0:14482:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787579512.953847:0:14482:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787579512.953849:0:14482:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787579512.953850:0:14482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787579512.953851:0:14482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787579512.953852:0:14482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787579512.953853:0:14482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787579512.953854:0:14482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787579512.953855:0:14482:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787579512.953856:0:14482:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787579512.953857:0:14482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787579512.953858:0:14482:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787579512.953887:0:14482:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787579512.953903:0:14482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab6bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616893824:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787579512.954013:0:14482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579512.954050:0:14482:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce92d479c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787579512.954312:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616893824 00000100:00100000:0.0:1787579512.954320:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616893824 00000100:00100000:0.0:1787579512.954376:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787579512.954386:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf38f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+5:14482:x1874412616893824:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787579512.954421:0:14495:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787579512.954424:0:14495:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787579512.954427:0:14495:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1787579512.970102:0:14516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787579512.970544:0:14495:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1787579512.972520:0:14517:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787579512.972533:0:14517:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787579512.972536:0:14517:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787579512.972577:0:14517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1787579512.973426:0:14495:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787579512.973448:0:14495:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787579512.988842:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf38f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+5:14482:x1874412616893824:12345-0@lo:253:mount.lustre.0 Request processed in 34450us (34821us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579512.988855:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787579512.989384:0:14482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab6bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616893824:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787579512.989399:0:14482:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787579512.989402:0:14482:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787579512.989403:0:14482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787579512.989405:0:14482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787579512.989406:0:14482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787579512.989407:0:14482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787579512.989408:0:14482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787579512.989409:0:14482:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787579512.989411:0:14482:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787579512.989413:0:14482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787579512.989414:0:14482:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787579512.989431:0:14482:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0ce91c07000 from lustre-MDT0000 10000000:01000000:3.0:1787579512.989470:0:14482:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787579512.989473:0:14482:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787579512.989477:0:14482:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffffa0ceb485cd28 10000000:01000000:3.0:1787579512.989481:0:14482:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787579512.989488:0:14482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa0ceb485cd28 from 1 10000000:01000000:3.0:1787579512.989491:0:14482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787579512.989523:0:14482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce90a8b600/0xb72beeaffa1b7d59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579512.989533:0:14482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ce90a8b600/0xb72beeaffa1b7d59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579512.989543:0:14482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce90a8b600/0xb72beeaffa1b7d59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579512.989561:0:14482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab6bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616893952:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787579512.989616:0:14482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579512.989653:0:14482:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce92d47780 going to sleep for 11 seconds 00000100:00100000:1.0:1787579512.989766:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616893952 00000100:00100000:1.0:1787579512.989772:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616893952 00000100:00100000:1.0:1787579512.989814:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787579512.989823:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf38fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+5:14482:x1874412616893952:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787579512.989834:0:14494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579512.989847:0:14494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceb47c9a00/0xb72beeaffa1b7d60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b7d59 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579512.989869:0:14494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceb47c9a00/0xb72beeaffa1b7d60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b7d59 expref: 6 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579512.989878:0:14494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceb47c9a00/0xb72beeaffa1b7d60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b7d59 expref: 6 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579512.989887:0:14494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb47c9a00, rc 0) 00000100:00100000:1.0:1787579512.989961:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf38fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+6:14482:x1874412616893952:12345-0@lo:101:mount.lustre.0 Request processed in 138us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579512.989968:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787579512.991506:0:14482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab6bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616893952:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787579512.991526:0:14482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce90a8b600/0xb72beeaffa1b7d59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7d60 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579512.991536:0:14482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce90a8b600/0xb72beeaffa1b7d59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b7d60 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579512.991601:0:14482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab6bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616894080:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787579512.991644:0:14482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579512.991684:0:14482:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce92d47780 going to sleep for 11 seconds 00000100:00100000:1.0:1787579512.992083:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616894080 00000100:00100000:1.0:1787579512.992090:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616894080 00000100:00100000:1.0:1787579512.993152:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787579512.993168:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf38e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+6:14482:x1874412616894080:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787579512.993636:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf38e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+6:14482:x1874412616894080:12345-0@lo:501:mount.lustre.0 Request processed in 472us (1989us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787579512.993652:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787579512.993754:0:14482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab6bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616894080:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787579512.993788:0:14482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787579512.993810:0:14482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce90a8b600/0xb72beeaffa1b7d59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7d60 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579512.993821:0:14482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce90a8b600/0xb72beeaffa1b7d59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7d60 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579512.993829:0:14482:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0ce91c07000 10000000:01000000:3.0:1787579512.993834:0:14482:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787579512.993837:0:14482:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffffa0ce91c07000 10000000:01000000:3.0:1787579512.993840:0:14482:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787579512.993843:0:14482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffffa0ce91c07000 from 1 10000000:01000000:3.0:1787579512.993845:0:14482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787579512.993872:0:14482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce90a8ae00/0xb72beeaffa1b7d67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579512.993886:0:14482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ce90a8ae00/0xb72beeaffa1b7d67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579512.993897:0:14482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce90a8ae00/0xb72beeaffa1b7d67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579512.993915:0:14482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab6bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616894208:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787579512.993968:0:14482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579513.000202:0:14482:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce92d47780 going to sleep for 11 seconds 00000100:00100000:2.0:1787579513.008332:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616894208 00000100:00100000:2.0:1787579513.008355:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616894208 00000100:00100000:1.0:1787579513.010400:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787579513.010413:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce893fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+6:14482:x1874412616894208:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787579513.010431:0:14494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579513.010461:0:14494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceb47c9800/0xb72beeaffa1b7d6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b7d67 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579513.010489:0:14494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceb47c9800/0xb72beeaffa1b7d6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b7d67 expref: 7 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579513.010500:0:14494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceb47c9800/0xb72beeaffa1b7d6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b7d67 expref: 7 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579513.010507:0:14494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb47c9800, rc 0) 00000100:00100000:1.0:1787579513.010587:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce893fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+7:14482:x1874412616894208:12345-0@lo:101:mount.lustre.0 Request processed in 176us (16618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579513.010593:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787579513.011679:0:14482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab6bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616894208:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787579513.011701:0:14482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce90a8ae00/0xb72beeaffa1b7d67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7d6e expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579513.011712:0:14482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce90a8ae00/0xb72beeaffa1b7d67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b7d6e expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579513.011729:0:14482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787579513.011759:0:14482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce90a8ae00/0xb72beeaffa1b7d67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7d6e expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579513.011767:0:14482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce90a8ae00/0xb72beeaffa1b7d67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7d6e expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579513.011774:0:14482:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787579513.011779:0:14482:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787579513.011785:0:14482:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffffa0ce91c07000 10000000:01000000:2.0:1787579513.011787:0:14482:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787579513.011802:0:14482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787579513.011805:0:14482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787579513.011832:0:14482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba318400/0xb72beeaffa1b7d75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579513.011840:0:14482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ceba318400/0xb72beeaffa1b7d75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579513.011848:0:14482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ceba318400/0xb72beeaffa1b7d75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579513.011867:0:14482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616894336:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787579513.011910:0:14482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579513.011988:0:14482:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce910c9180 going to sleep for 11 seconds 00000100:00100000:3.0:1787579513.012562:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616894336 00000100:00100000:3.0:1787579513.012569:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616894336 00000100:00100000:3.0:1787579513.012602:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787579513.012609:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce893fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+7:14482:x1874412616894336:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787579513.012620:0:14494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579513.012631:0:14494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce90a8ba00/0xb72beeaffa1b7d7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b7d75 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579513.012647:0:14494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce90a8ba00/0xb72beeaffa1b7d7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b7d75 expref: 8 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579513.012655:0:14494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce90a8ba00/0xb72beeaffa1b7d7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b7d75 expref: 8 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579513.012662:0:14494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce90a8ba00, rc 0) 00000100:00100000:3.0:1787579513.012700:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce893fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+8:14482:x1874412616894336:12345-0@lo:101:mount.lustre.0 Request processed in 91us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579513.012707:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787579513.012821:0:14482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616894336:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787579513.012832:0:14482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ceba318400/0xb72beeaffa1b7d75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7d7c expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579513.012839:0:14482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ceba318400/0xb72beeaffa1b7d75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b7d7c expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579513.012897:0:14482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616894464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787579513.012953:0:14482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579513.012987:0:14482:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce910c9180 going to sleep for 11 seconds 00000100:00100000:3.0:1787579513.013095:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616894464 00000100:00100000:3.0:1787579513.013100:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616894464 00000100:00100000:3.0:1787579513.013118:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787579513.013137:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+8:14482:x1874412616894464:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787579513.013885:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+9:14482:x1874412616894464:12345-0@lo:501:mount.lustre.0 Request processed in 758us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579513.013894:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787579513.015975:0:14482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616894464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787579513.016051:0:14482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616894592:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787579513.016138:0:14482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579513.016196:0:14482:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce910c9180 going to sleep for 11 seconds 00000100:00100000:3.0:1787579513.017655:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616894592 00000100:00100000:3.0:1787579513.017665:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616894592 00000100:00100000:3.0:1787579513.017720:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787579513.017729:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+9:14482:x1874412616894592:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787579513.018125:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+9:14482:x1874412616894592:12345-0@lo:503:mount.lustre.0 Request processed in 395us (1986us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579513.018133:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787579513.020565:0:14482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616894592:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787579513.026611:0:14518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6514e2d9-be54-4793-9feb-dcbd6b926656:14518:1874412616894720:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787579513.026692:0:14518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579513.026736:0:14518:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce867e8240 going to sleep for 11 seconds 00000100:00100000:3.0:1787579513.028117:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616894720 00000100:00100000:3.0:1787579513.028145:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616894720 00000100:00100000:3.0:1787579513.028200:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787579513.028221:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+9:14518:x1874412616894720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787579513.028959:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+9:14518:x1874412616894720:12345-0@lo:502:llog_process_th.0 Request processed in 748us (2264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579513.028969:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787579513.029137:0:14518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6514e2d9-be54-4793-9feb-dcbd6b926656:14518:1874412616894720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787579513.029179:0:14518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787579513.029189:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787579513.029191:0:14518:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787579513.029197:0:14518:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787579513.029200:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787579513.029222:0:14518:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffffa0ceb3d599b8) 00000020:00000080:2.0:1787579513.029239:0:14518:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787579513.029244:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787579513.029305:0:14518:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787579513.029312:0:14518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb72beeaffa1b7d8a 00000020:00000080:2.0:1787579513.029915:0:14518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787579513.029921:0:14518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787579513.029959:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787579513.029962:0:14518:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787579513.029966:0:14518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787579513.029970:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787579513.029971:0:14518:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787579513.029983:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787579513.029992:0:14518:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffffa0ce86748000) 00000020:00000080:2.0:1787579513.030003:0:14518:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787579513.030007:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787579513.030009:0:14518:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787579513.030011:0:14518:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787579513.030017:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787579513.030070:0:14518:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0ce91c07000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787579513.030084:0:14518:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffffa0ce8674b370) 00000020:00000080:2.0:1787579513.030091:0:14518:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787579513.033765:0:14518:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787579513.033781:0:14518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb72beeaffa1b7d9f 00000020:00000080:3.0:1787579513.033980:0:14518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787579513.033988:0:14518:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787579513.033992:0:14518:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xb72beeaffa1b7da6 00080000:01000000:3.0:1787579513.033998:0:14518:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787579513.034003:0:14518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb72beeaffa1b7dad 00010000:00010000:1.0:1787579513.149505:0:14518:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1787579513.149975:0:14518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:1.0:1787579513.150138:0:14518:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787579513.150759:0:14518:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffffa0ceb44acd28) 00000020:00000080:1.0:1787579513.150775:0:14518:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787579513.150849:0:14518:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787579513.150856:0:14518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb72beeaffa1b7dbb 00000020:00000080:3.0:1787579513.163770:0:14518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787579513.178906:0:14518:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xb72beeaffa1b7dc2 00000020:00000080:0.0:1787579513.184413:0:14518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787579513.184426:0:14518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787579513.184433:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579513.184445:0:14518:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787579513.184449:0:14518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787579513.184476:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579513.184478:0:14518:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787579513.184483:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787579513.184531:0:14518:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787579513.184548:0:14518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787579513.184552:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579513.184553:0:14518:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787579513.184555:0:14518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787579513.184557:0:14518:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1787579513.184558:0:14518:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787579513.184559:0:14518:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787579513.184561:0:14518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787579513.184562:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579513.184564:0:14518:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787579513.184566:0:14518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787579513.184570:0:14518:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787579513.184573:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579513.184574:0:14518:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787579513.184577:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787579513.184583:0:14518:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.153@tcp to nid 0x20000c0a8ce99 (192.168.206.153@tcp) 00000020:01000000:0.0:1787579513.184607:0:14518:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787579513.184611:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787579513.184625:0:14518:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffffa0ceb485b370) 00000020:00000080:0.0:1787579513.184641:0:14518:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1787579513.184646:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787579513.184700:0:14518:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787579513.184706:0:14518:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787579513.184713:0:14518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb72beeaffa1b7dd0 00010000:00080000:0.0:1787579513.184744:0:14518:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0ce9185d000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.153@tcp at head 00010000:00010000:0.0:1787579513.185317:0:14518:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1787579513.185916:0:14518:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787579513.186833:0:14518:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787579513.193765:0:14518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787579513.204719:0:14518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1787579513.204843:0:14518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787579513.213084:0:14522:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787579513.213092:0:14522:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787579513.237864:0:14518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787579513.237879:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787579513.237916:0:14518:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787579513.237965:0:14518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb72beeaffa1b7dd7 00000100:00080000:0.0:1787579513.237975:0:14518:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787579513.237981:0:14518:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa0ce9185d000 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:0.0:1787579513.238013:0:14518:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ceb46b6300 x1874412616894848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787579513.238038:0:14518:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787579513.238101:0:14518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787579513.238105:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579513.238107:0:14518:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787579513.238111:0:14518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787579513.238113:0:14518:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787579513.238115:0:14518:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787579513.238116:0:14518:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787579513.238118:0:14518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787579513.238120:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579513.238121:0:14518:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787579513.238123:0:14518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787579513.238127:0:14518:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787579513.238130:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579513.238131:0:14518:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787579513.238134:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787579513.238138:0:14518:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.153@tcp to nid 0x20000c0a8ce99 (192.168.206.153@tcp) 00000020:01000000:0.0:1787579513.238515:0:14518:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787579513.238519:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787579513.238531:0:14518:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffffa0ceb48599b8) 00000020:00000080:0.0:1787579513.238544:0:14518:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1787579513.238549:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787579513.238626:0:14518:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787579513.238631:0:14518:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787579513.238637:0:14518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb72beeaffa1b7de5 00010000:00080000:0.0:1787579513.238666:0:14518:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0ce9185c800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.153@tcp at head 00010000:00010000:0.0:1787579513.238863:0:14518:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1787579513.240321:0:14518:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787579513.240504:0:14518:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1787579513.241080:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616894848:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787579513.241153:0:3318:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874412616894848 offset 0 length 520: 4 00000040:00080000:1.0:1787579513.255778:0:14518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787579513.255882:0:14518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787579513.255984:0:14518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1787579513.265496:0:14524:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787579513.265504:0:14524:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787579513.266950:0:14518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787579513.266961:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787579513.266989:0:14518:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787579513.267004:0:14518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb72beeaffa1b7dec 00000100:00080000:2.0:1787579513.267013:0:14518:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787579513.267018:0:14518:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0ce9185c800 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:2.0:1787579513.267046:0:14518:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ceb480f480 x1874412616894976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787579513.267081:0:14518:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787579513.267119:0:14518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787579513.267123:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787579513.267124:0:14518:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787579513.267127:0:14518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787579513.267131:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787579513.267132:0:14518:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787579513.267135:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787579513.267137:0:14518:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787579513.267140:0:14518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787579513.267275:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787579513.267277:0:14518:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787579513.267287:0:14518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787579513.267290:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787579513.267291:0:14518:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787579513.267295:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787579513.267323:0:14518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6514e2d9-be54-4793-9feb-dcbd6b926656:14518:1874412616895104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787579513.267498:0:14518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579513.267541:0:14518:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cebf804cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787579513.267606:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616894976:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787579513.267632:0:3318:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874412616894976 offset 0 length 520: 4 00000100:00100000:0.0:1787579513.267712:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616895104 00000100:00100000:0.0:1787579513.267718:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616895104 00000100:00100000:0.0:1787579513.267755:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787579513.267762:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+9:14518:x1874412616895104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787579513.267981:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+9:14518:x1874412616895104:12345-0@lo:502:llog_process_th.0 Request processed in 218us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579513.267989:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787579513.268551:0:14518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6514e2d9-be54-4793-9feb-dcbd6b926656:14518:1874412616895104:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787579513.268577:0:14518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787579513.268584:0:14518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787579513.268585:0:14518:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787579513.268589:0:14518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787579513.270007:0:14482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1787579513.270038:0:14482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787579513.270060:0:14482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba318400/0xb72beeaffa1b7d75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7d7c expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579513.270080:0:14482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ceba318400/0xb72beeaffa1b7d75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7d7c expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579513.270088:0:14482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0ce91c07000 from 1 10000000:01000000:0.0:1787579513.270092:0:14482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787579513.270135:0:14482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9e00/0xb72beeaffa1b7df3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579513.270150:0:14482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9e00/0xb72beeaffa1b7df3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579513.270176:0:14482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9e00/0xb72beeaffa1b7df3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579513.270197:0:14482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616895232:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787579513.270697:0:14482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579513.270738:0:14482:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb1cb3180 going to sleep for 11 seconds 00000100:00100000:1.0:1787579513.270808:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616895232 00000100:00100000:1.0:1787579513.270816:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616895232 00000100:00100000:1.0:1787579513.270862:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787579513.270872:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+9:14482:x1874412616895232:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787579513.270883:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579513.270896:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceb47c9600/0xb72beeaffa1b7dfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b7df3 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579513.270919:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceb47c9600/0xb72beeaffa1b7dfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b7df3 expref: 10 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579513.270962:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceb47c9600/0xb72beeaffa1b7dfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b7df3 expref: 10 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579513.270971:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb47c9600, rc 0) 00000100:00100000:1.0:1787579513.271009:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+10:14482:x1874412616895232:12345-0@lo:101:mount.lustre.0 Request processed in 139us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579513.271016:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787579513.272253:0:14482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616895232:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787579513.272274:0:14482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9e00/0xb72beeaffa1b7df3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7dfa expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579513.272284:0:14482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9e00/0xb72beeaffa1b7df3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b7dfa expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579513.274611:0:14482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616895360:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787579513.274688:0:14482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579513.274796:0:14482:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cebf804cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787579513.280055:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616895360 00000100:00100000:1.0:1787579513.280507:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616895360 00000100:00100000:1.0:1787579513.280598:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787579513.280609:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+10:14482:x1874412616895360:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787579513.280631:0:14494:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787579513.280648:0:14494:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787579513.280759:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+10:14482:x1874412616895360:12345-0@lo:256:mount.lustre.0 Request processed in 152us (6071us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579513.280767:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787579513.280849:0:14482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616895360:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787579513.284816:0:14482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787579513.284855:0:14482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9e00/0xb72beeaffa1b7df3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7dfa expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579513.284869:0:14482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9e00/0xb72beeaffa1b7df3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7dfa expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579513.284878:0:14482:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0ce91c07000 from 1 10000000:01000000:0.0:1787579513.284880:0:14482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787579513.284919:0:14482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9a00/0xb72beeaffa1b7e01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579513.284942:0:14482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9a00/0xb72beeaffa1b7e01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579513.284952:0:14482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9a00/0xb72beeaffa1b7e01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579513.284973:0:14482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616895488:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787579513.285034:0:14482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579513.292596:0:14482:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb1cb3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787579513.292807:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616895488 00000100:00100000:2.0:1787579513.292817:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616895488 00000100:00100000:2.0:1787579513.292864:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787579513.292873:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1492450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+10:14482:x1874412616895488:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787579513.292889:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579513.292908:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceba319c00/0xb72beeaffa1b7e08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b7e01 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579513.292967:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceba319c00/0xb72beeaffa1b7e08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b7e01 expref: 11 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579513.292977:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceba319c00/0xb72beeaffa1b7e08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b7e01 expref: 11 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579513.292984:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319c00, rc 0) 00000100:00100000:2.0:1787579513.293054:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1492450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+11:14482:x1874412616895488:12345-0@lo:101:mount.lustre.0 Request processed in 182us (8019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579513.293060:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787579513.295905:0:14482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616895488:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787579513.295961:0:14482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9a00/0xb72beeaffa1b7e01 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7e08 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579513.295972:0:14482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9a00/0xb72beeaffa1b7e01 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b7e08 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579513.296044:0:14482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616895616:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787579513.296112:0:14482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579513.296165:0:14482:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb1cb3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787579513.297203:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616895616 00000100:00100000:2.0:1787579513.297223:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616895616 00000100:00100000:2.0:1787579513.297262:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787579513.297272:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+11:14482:x1874412616895616:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787579513.297984:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+11:14482:x1874412616895616:12345-0@lo:501:mount.lustre.0 Request processed in 711us (1869us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579513.297993:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787579513.298389:0:14482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616895616:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787579513.298448:0:14482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616895744:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787579513.298498:0:14482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579513.298533:0:14482:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb1cb3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787579513.300766:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616895744 00000100:00100000:2.0:1787579513.300779:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616895744 00000100:00100000:2.0:1787579513.300826:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787579513.300835:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1493850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+11:14482:x1874412616895744:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787579513.301106:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1493850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+11:14482:x1874412616895744:12345-0@lo:503:mount.lustre.0 Request processed in 271us (2607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579513.301114:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787579513.302551:0:14482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616895744:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787579513.302781:0:14526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6514e2d9-be54-4793-9feb-dcbd6b926656:14526:1874412616895872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787579513.302838:0:14526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579513.302864:0:14526:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb1cb3180 going to sleep for 11 seconds 00000100:00100000:2.0:1787579513.302917:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616895872 00000100:00100000:2.0:1787579513.302923:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616895872 00000100:00100000:2.0:1787579513.302983:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787579513.302991:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1492850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+11:14526:x1874412616895872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787579513.303689:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1492850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+11:14526:x1874412616895872:12345-0@lo:502:llog_process_th.0 Request processed in 697us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579513.303698:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787579513.303789:0:14526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6514e2d9-be54-4793-9feb-dcbd6b926656:14526:1874412616895872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787579513.303814:0:14526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787579513.303822:0:14526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579513.303825:0:14526:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787579513.303831:0:14526:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0ce91c07000 00000020:00000080:0.0:1787579513.303833:0:14526:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787579513.303841:0:14526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787579513.303849:0:14526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579513.303850:0:14526:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787579513.303853:0:14526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787579513.303856:0:14526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579513.303857:0:14526:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787579513.303860:0:14526:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0ce91c07000 00000020:00000080:0.0:1787579513.303863:0:14526:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787579513.303914:0:14526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787579513.303918:0:14526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579513.303919:0:14526:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787579513.303921:0:14526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787579513.303945:0:14526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579513.303947:0:14526:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787579513.303951:0:14526:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0ce91c07000 00000020:00000080:0.0:1787579513.303953:0:14526:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787579513.303989:0:14526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6514e2d9-be54-4793-9feb-dcbd6b926656:14526:1874412616896000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787579513.304022:0:14526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579513.304052:0:14526:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb1cb3180 going to sleep for 11 seconds 00000100:00100000:3.0:1787579513.304626:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616896000 00000100:00100000:3.0:1787579513.304633:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616896000 00000100:00100000:3.0:1787579513.304670:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787579513.304677:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+11:14526:x1874412616896000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787579513.304845:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+11:14526:x1874412616896000:12345-0@lo:502:llog_process_th.0 Request processed in 168us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579513.304852:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787579513.305491:0:14526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6514e2d9-be54-4793-9feb-dcbd6b926656:14526:1874412616896000:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787579513.305520:0:14526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787579513.305526:0:14526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579513.305528:0:14526:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787579513.305533:0:14526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787579513.307347:0:14482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787579513.307491:0:14482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787579513.307514:0:14482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9a00/0xb72beeaffa1b7e01 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7e08 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579513.307526:0:14482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9a00/0xb72beeaffa1b7e01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7e08 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579513.307571:0:14482:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787579513.307574:0:14482:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0ce91c07000 10000000:01000000:3.0:1787579513.307576:0:14482:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0ce91c07000 10000000:01000000:3.0:1787579513.307582:0:14482:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787579513.307588:0:14482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0ce91c07000 from 1 10000000:01000000:3.0:1787579513.307602:0:14482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787579513.307636:0:14482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce90a8b000/0xb72beeaffa1b7e0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579513.307643:0:14482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ce90a8b000/0xb72beeaffa1b7e0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579513.307653:0:14482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce90a8b000/0xb72beeaffa1b7e0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579513.307675:0:14482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab68e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616896128:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787579513.307732:0:14482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579513.307770:0:14482:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce91280d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787579513.307791:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616896128 00000100:00100000:3.0:1787579513.307797:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616896128 00000100:00100000:3.0:1787579513.307845:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787579513.307854:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+11:14482:x1874412616896128:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787579513.307865:0:14494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579513.307877:0:14494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce90a8bc00/0xb72beeaffa1b7e16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b7e0f expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579513.307899:0:14494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce90a8bc00/0xb72beeaffa1b7e16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b7e0f expref: 12 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579513.307908:0:14494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce90a8bc00/0xb72beeaffa1b7e16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b7e0f expref: 12 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579513.307916:0:14494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce90a8bc00, rc 0) 00000100:00100000:3.0:1787579513.307983:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+12:14482:x1874412616896128:12345-0@lo:101:mount.lustre.0 Request processed in 129us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579513.307997:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787579513.308040:0:14482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab68e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616896128:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787579513.308053:0:14482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce90a8b000/0xb72beeaffa1b7e0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7e16 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579513.308061:0:14482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce90a8b000/0xb72beeaffa1b7e0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b7e16 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579513.308119:0:14482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab68e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616896256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787579513.308157:0:14482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579513.308169:0:14482:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce91280d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787579513.308182:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616896256 00000100:00100000:3.0:1787579513.308186:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616896256 00000100:00100000:0.0:1787579513.308627:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787579513.308637:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf63c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+12:14482:x1874412616896256:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787579513.328150:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf63c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+12:14482:x1874412616896256:12345-0@lo:501:mount.lustre.0 Request processed in 19497us (19974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579513.328166:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787579513.333821:0:14482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab68e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616896256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787579513.333887:0:14482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab68e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616896384:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787579513.333980:0:14482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579513.334015:0:14482:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce91280d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787579513.334113:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616896384 00000100:00100000:3.0:1787579513.334119:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616896384 00000100:00100000:3.0:1787579513.334169:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787579513.334178:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf63dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+12:14482:x1874412616896384:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787579513.335165:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf63dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+12:14482:x1874412616896384:12345-0@lo:503:mount.lustre.0 Request processed in 985us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579513.335174:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787579513.335319:0:14482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab68e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616896384:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787579513.343430:0:14530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6514e2d9-be54-4793-9feb-dcbd6b926656:14530:1874412616896512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787579513.343520:0:14530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579513.343564:0:14530:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce867e8000 going to sleep for 11 seconds 00000100:00100000:3.0:1787579513.343687:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616896512 00000100:00100000:3.0:1787579513.343695:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616896512 00000100:00100000:3.0:1787579513.343737:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787579513.343746:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf63cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+12:14530:x1874412616896512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787579513.344004:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf63cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+12:14530:x1874412616896512:12345-0@lo:502:llog_process_th.0 Request processed in 258us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579513.344012:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787579513.346816:0:14530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6514e2d9-be54-4793-9feb-dcbd6b926656:14530:1874412616896512:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787579513.346896:0:14530:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787579513.346912:0:14530:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffffa0ceb44ab370) 00000020:00000080:1.0:1787579513.346947:0:14530:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1787579513.347029:0:14530:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0ce91c07000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787579513.347033:0:14530:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0ce91c07000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787579513.347036:0:14530:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0ce91c07000 4 00010000:00080000:1.0:1787579513.347062:0:14530:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0ceaf5c8000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.153@tcp at head 00010000:00010000:1.0:1787579513.357808:0:14530:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1787579513.358033:0:14530:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787579513.358079:0:14530:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787579513.358095:0:14530:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xb72beeaffa1b7e24 00000100:00080000:1.0:1787579513.358104:0:14530:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787579513.358110:0:14530:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffffa0ceaf5c8000 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:1.0:1787579513.364710:0:14530:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ceb468a300 x1874412616896640/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787579513.364789:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874412616896640:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787579513.364866:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787579513.364942:0:14530:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787579513.371583:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616896640 00000100:00100000:1.0:1787579513.371595:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616896640 00000100:00100000:1.0:1787579513.371628:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787579513.371636:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3318:x1874412616896640:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787579513.382316:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3318:x1874412616896640:12345-0@lo:38:llog_process_th.0 Request processed in 10667us (17437us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787579513.382331:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787579513.385336:0:14530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4688000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6514e2d9-be54-4793-9feb-dcbd6b926656:14530:1874412616896768:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787579513.385946:0:14530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579513.385991:0:14530:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce867e8240 going to sleep for 11 seconds 00000100:00100000:1.0:1787579513.386027:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616896768 00000100:00100000:1.0:1787579513.386033:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616896768 00000100:00100000:1.0:1787579513.386300:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787579513.386309:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf63c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+12:14530:x1874412616896768:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787579513.386637:0:3318:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787579513.386645:0:3318:0:(import.c:65:import_set_state_nolock()) ffffa0ceaf5c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787579513.386649:0:3318:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787579513.386652:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874412616896640:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787579513.388495:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf63c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+12:14530:x1874412616896768:12345-0@lo:502:llog_process_th.0 Request processed in 2181us (2544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579513.388507:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787579513.388655:0:14530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4688000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6514e2d9-be54-4793-9feb-dcbd6b926656:14530:1874412616896768:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787579513.388690:0:14530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787579513.388841:0:14482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787579513.388860:0:14482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787579513.388884:0:14482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce90a8b000/0xb72beeaffa1b7e0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7e16 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579513.388894:0:14482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce90a8b000/0xb72beeaffa1b7e0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7e16 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787579513.388968:0:14482:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787579513.388970:0:14482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787579513.388971:0:14482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787579513.388972:0:14482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787579513.388973:0:14482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787579513.388975:0:14482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787579513.388976:0:14482:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787579513.388978:0:14482:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787579513.388979:0:14482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787579513.388981:0:14482:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787579513.388984:0:14482:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1787579513.388986:0:14482:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787579513.388987:0:14482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787579513.388989:0:14482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787579513.388990:0:14482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787579513.388990:0:14482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787579513.388991:0:14482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787579513.388992:0:14482:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787579513.388999:0:14482:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787579513.389000:0:14482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787579513.389001:0:14482:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787579513.389020:0:14482:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787579513.389034:0:14482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab68e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616896896:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787579513.389085:0:14482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579513.389116:0:14482:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce912806c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787579513.389362:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616896896 00000100:00100000:2.0:1787579513.389377:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616896896 00000100:00100000:2.0:1787579513.391658:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787579513.391673:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf63d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+12:14482:x1874412616896896:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787579513.391704:0:14494:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787579513.391717:0:14494:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787579513.464363:0:14494:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787579513.464538:0:14494:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787579513.464597:0:14516:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787579513.464602:0:14516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787579513.464622:0:14516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0ceb47c9c00/0xb72beeaffa1b7e2b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579513.464640:0:14516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ceb47c9600/0xb72beeaffa1b7dfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b7df3 expref: 12 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579513.464647:0:14516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0ceb47c9c00/0xb72beeaffa1b7e2b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579513.464682:0:14516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ceb47c9600/0xb72beeaffa1b7dfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b7df3 expref: 12 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579513.464695:0:14516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0ceb47c9600/0xb72beeaffa1b7dfa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b7df3 expref: 12 pid: 14495 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579513.464726:0:14516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4688000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14516:1874412616897024:0@lo:104: 00000100:00100000:1.0:1787579513.464783:0:14516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579513.464841:0:14516:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce867e8240 going to sleep for 11 seconds 00000100:00100000:2.0:1787579513.465080:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616897024 00000100:00100000:2.0:1787579513.465087:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616897024 00000100:00100000:0.0:1787579513.465668:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787579513.465679:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb468aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6514e2d9-be54-4793-9feb-dcbd6b926656+3:14516:x1874412616897024:12345-0@lo:104: 00010000:00010000:0.0:1787579513.465693:0:14484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9e00/0xb72beeaffa1b7df3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b7dfa expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579513.465763:0:14484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787579513.465769:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb468aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6514e2d9-be54-4793-9feb-dcbd6b926656+3:14516:x1874412616897024:12345-0@lo:104: Request processed in 93us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579513.465776:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787579513.465799:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787579513.465805:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9e00/0xb72beeaffa1b7df3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b7dfa expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579513.465822:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9e00 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:0.0:1787579513.465826:0:14489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9e00/0xb72beeaffa1b7df3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b7dfa expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579513.465834:0:14489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9e00/0xb72beeaffa1b7df3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b7dfa expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787579513.465841:0:14489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9e00/0xb72beeaffa1b7df3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b7dfa expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579513.465856:0:14489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787579513.465886:0:14489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9e00/0xb72beeaffa1b7df3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b7dfa expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579513.465892:0:14489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787579513.465910:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9e00/0xb72beeaffa1b7df3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b7dfa expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579513.465916:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9e00/0xb72beeaffa1b7df3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b7dfa expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579513.465955:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579513.465957:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579513.465959:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579513.465989:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6514e2d9-be54-4793-9feb-dcbd6b926656:3321:1874412616897152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787579513.466020:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579513.466093:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616897152 00000100:00100000:0.0:1787579513.466098:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616897152 00010000:00010000:0.0:1787579513.466114:0:14485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ceb47c9600/0xb72beeaffa1b7dfa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b7df3 expref: 13 pid: 14495 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579513.466654:0:14516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4688000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14516:1874412616897024:0@lo:104: 00010000:00010000:1.0:1787579513.466673:0:14516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0ceb47c9c00/0xb72beeaffa1b7e2b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579513.466791:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787579513.466800:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6514e2d9-be54-4793-9feb-dcbd6b926656+13:3321:x1874412616897152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787579513.467860:0:14485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579513.467872:0:14485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ceb47c9600/0xb72beeaffa1b7dfa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b7df3 expref: 13 pid: 14495 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579513.467884:0:14485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ceb47c9600/0xb72beeaffa1b7dfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b7df3 expref: 13 pid: 14495 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579513.467904:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ceb47c9600/0xb72beeaffa1b7dfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b7df3 expref: 13 pid: 14495 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579513.467919:0:14485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0ceb47c9c00/0xb72beeaffa1b7e2b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579513.467953:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceb47c9c00/0xb72beeaffa1b7e2b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787579513.467968:0:14485:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003366996s 00010000:00010000:0.0:1787579513.467972:0:14485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0ceb47c9c00/0xb72beeaffa1b7e2b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579513.467978:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0ceb47c9c00/0xb72beeaffa1b7e2b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579513.467983:0:14485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0ceb47c9c00/0xb72beeaffa1b7e2b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579513.467988:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0ceb47c9c00/0xb72beeaffa1b7e2b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579513.467993:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c9c00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:0.0:1787579513.467997:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0ceb47c9c00/0xb72beeaffa1b7e2b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579513.468003:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0ceb47c9c00/0xb72beeaffa1b7e2b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579513.468014:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0ceb47c9c00/0xb72beeaffa1b7e2b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579513.468029:0:14485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579513.468099:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6514e2d9-be54-4793-9feb-dcbd6b926656+12:3321:x1874412616897152:12345-0@lo:103:ldlm_bl.0 Request processed in 1300us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579513.468107:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787579513.468272:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6514e2d9-be54-4793-9feb-dcbd6b926656:3321:1874412616897152:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787579513.468335:0:14516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0ceb47c9c00/0xb72beeaffa1b7e2b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579513.468351:0:14516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0ceb47c9c00/0xb72beeaffa1b7e2b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579513.468356:0:14516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ceb47c9c00/0xb72beeaffa1b7e2b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579513.555636:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf63d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+11:14482:x1874412616896896:12345-0@lo:253:mount.lustre.0 Request processed in 163958us (166542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579513.555650:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787579513.555856:0:14482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab68e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:14482:1874412616896896:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787579513.555872:0:14482:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787579513.555875:0:14482:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787579513.555877:0:14482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787579513.555878:0:14482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787579513.555879:0:14482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787579513.555880:0:14482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787579513.555882:0:14482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787579513.555883:0:14482:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787579513.555884:0:14482:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787579513.555886:0:14482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787579513.555888:0:14482:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787579513.555901:0:14482:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787579513.566696:0:14482:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787579513.566865:0:14482:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787579513.567173:0:14482:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787579513.567324:0:14482:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787579513.567606:0:14482:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787579513.567755:0:14482:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1787579513.584033:0:14482:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1787579513.584234:0:14482:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1787579513.584514:0:14482:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1787579513.584724:0:14482:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1787579513.585027:0:14482:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1787579513.585171:0:14482:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1787579513.615608:0:14482:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000020:00080000:0.0:1787579513.616572:0:14538:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1787579513.616577:0:14538:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1787579513.616592:0:14482:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1787579513.617087:0:14539:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1787579513.617174:0:14539:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787579513.619241:0:14539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787579513.619310:0:14539:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787579513.619314:0:14539:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1787579513.623053:0:14482:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787579513.623321:0:14482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787579513.623904:0:14482:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787579513.623912:0:14482:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787579513.624754:0:14482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787579513.626574:0:14482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787579513.627507:0:14482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787579513.627548:0:14482:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1787579513.629890:0:14482:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00010000:00010000:2.0:1787579513.636798:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1787579513.639312:0:14482:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1787579513.683295:0:14482:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787579513.683328:0:14482:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaf09c1557988 00100000:10000000:3.0:1787579513.683347:0:14482:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787579513.686104:0:14482:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787579513.686121:0:14482:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.153@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787579513.686136:0:14482:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787579513.686159:0:14482:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 10000000:01000000:2.0:1787579514.337059:0:14497:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787579514.337066:0:14497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0ce91c07000 from 6 10000000:01000000:2.0:1787579514.337070:0:14497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787579514.337106:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b7e32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579514.337123:0:14497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b7e32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579514.337135:0:14497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b7e32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579514.337157:0:14497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616897280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787579514.337213:0:14497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579514.337270:0:14497:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce856fdb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787579514.337313:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616897280 00000100:00100000:0.0:1787579514.337320:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616897280 00000100:00100000:0.0:1787579514.337364:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787579514.337374:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf63d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+11:14497:x1874412616897280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787579514.337386:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579514.337406:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceba3c9000/0xb72beeaffa1b7e39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b7e32 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579514.337427:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceba3c9000/0xb72beeaffa1b7e39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b7e32 expref: 12 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579514.337456:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceba3c9000/0xb72beeaffa1b7e39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b7e32 expref: 12 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579514.337465:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c9000, rc 0) 00000100:00100000:0.0:1787579514.337505:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf63d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+12:14497:x1874412616897280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579514.337511:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787579514.337801:0:14497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616897280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787579514.337815:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b7e32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7e39 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579514.337824:0:14497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b7e32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b7e39 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579514.337867:0:14497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616897408:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787579514.337894:0:14497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579514.337920:0:14497:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce856fdb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787579514.338044:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616897408 00000100:00100000:0.0:1787579514.338049:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616897408 00000100:00100000:0.0:1787579514.338078:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787579514.338084:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf63f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+12:14497:x1874412616897408:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787579514.338105:0:14494:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787579514.338117:0:14494:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787579514.338120:0:14494:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787579514.338183:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf63f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+12:14497:x1874412616897408:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 98us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579514.338190:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787579514.339756:0:14497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616897408:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787579514.339813:0:14497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787579514.339822:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b7e32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7e39 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579514.339832:0:14497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b7e32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7e39 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787579514.404018:0:14534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787579514.660687:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787579515.431353:0:14534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787579515.681090:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579516.717964:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579517.728178:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787579518.432583:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787579518.432591:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787579518.432593:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787579518.432596:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787579518.432599:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787579518.432602:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787579518.432605:0:36:0:(import.c:65:import_set_state_nolock()) ffffa0ceaf5c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787579518.432616:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffffa0ceaf5c8000 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:0.0:1787579518.432637:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ceb46b6680 x1874412616897664/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787579518.432663:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787579518.432674:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6514e2d9-be54-4793-9feb-dcbd6b926656:3321:1874412616897536:0@lo:400:kworker.0 00000100:00100000:0.0:1787579518.432739:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579518.432799:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616897536 00000100:00100000:0.0:1787579518.432811:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616897536 00000100:00100000:0.0:1787579518.432849:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787579518.432858:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf63fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+12:3321:x1874412616897536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579518.432904:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf63fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+12:3321:x1874412616897536:12345-0@lo:400:kworker.0 Request processed in 47us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579518.432910:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787579518.432961:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874412616897664:0@lo:38:kworker.0 00000100:00100000:0.0:1787579518.432986:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579518.433022:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6514e2d9-be54-4793-9feb-dcbd6b926656:3321:1874412616897536:0@lo:400:kworker.0 00000100:00100000:2.0:1787579518.436606:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616897664 00000100:00100000:2.0:1787579518.436618:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616897664 00000100:00100000:2.0:1787579518.436648:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787579518.436655:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3318:x1874412616897664:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787579518.436679:0:14502:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 454 last 0 00000020:00000080:2.0:1787579518.436711:0:14502:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xb72beeaffa1b7e40 00000004:00100000:2.0:1787579518.436724:0:14502:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787579518.436831:0:14502:0:(import.c:65:import_set_state_nolock()) ffffa0ce98775800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787579518.436948:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874412616897664:12345-0@lo:38:kworker.0 Request processed in 271us (3939us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579518.436956:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787579518.437823:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0ceb46b6680 x1874412616897664/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787579528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787579518.437839:0:3318:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787579518.437846:0:3318:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787579518.437850:0:3318:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787579518.437852:0:3318:0:(import.c:65:import_set_state_nolock()) ffffa0ceaf5c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787579518.437858:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874412616897664:0@lo:38:kworker.0 00010000:00010000:2.0:1787579518.752830:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787579519.230195:0:14782:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg653-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787579519.789516:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579520.803018:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579521.824028:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579522.848275:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787579523.229840:0:14932:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec7171480 20000000:00000080:1.0:1787579523.229870:0:14932:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0ceb5c9b400 uarg=0000000000000000 20000000:01000000:1.0:1787579523.229922:0:14932:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787579523.229966:0:14932:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787579523.229973:0:14932:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787579523.231778:0:14933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1787579523.231968:0:14932:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787579523.252273:0:14932:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787579523.262246:0:14932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0ce90a8a800/0xb72beeaffa1b7e47 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579523.262280:0:14932:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ceba319c00/0xb72beeaffa1b7e08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b7e01 expref: 11 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579523.262291:0:14932:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0ce90a8a800/0xb72beeaffa1b7e47 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579523.262351:0:14932:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ceba319c00/0xb72beeaffa1b7e08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b7e01 expref: 11 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579523.262372:0:14932:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0ceba319c00/0xb72beeaffa1b7e08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b7e01 expref: 11 pid: 14495 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579523.262402:0:14932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab6ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14932:1874412616897792:0@lo:104: 00000100:00100000:3.0:1787579523.263788:0:14932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579523.263949:0:14932:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce87c05180 going to sleep for 11 seconds 00000100:00100000:2.0:1787579523.275181:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616897792 00000100:00100000:2.0:1787579523.275201:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616897792 00000100:00100000:2.0:1787579523.275275:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787579523.275286:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6514e2d9-be54-4793-9feb-dcbd6b926656+3:14932:x1874412616897792:12345-0@lo:104: 00010000:00010000:2.0:1787579523.275310:0:14483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9a00/0xb72beeaffa1b7e01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b7e08 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579523.275493:0:14483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787579523.275500:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6514e2d9-be54-4793-9feb-dcbd6b926656+3:14932:x1874412616897792:12345-0@lo:104: Request processed in 216us (11719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579523.275528:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787579523.275565:0:14488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787579523.275572:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9a00/0xb72beeaffa1b7e01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b7e08 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579523.275581:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9a00 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:2.0:1787579523.275586:0:14488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9a00/0xb72beeaffa1b7e01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b7e08 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579523.275596:0:14488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9a00/0xb72beeaffa1b7e01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b7e08 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787579523.275604:0:14488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9a00/0xb72beeaffa1b7e01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b7e08 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579523.275611:0:14488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787579523.275665:0:14488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9a00/0xb72beeaffa1b7e01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b7e08 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579523.275673:0:14488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787579523.275707:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9a00/0xb72beeaffa1b7e01 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b7e08 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579523.275715:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9a00/0xb72beeaffa1b7e01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b7e08 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579523.275735:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579523.275737:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579523.275739:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579523.275776:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787579523.275799:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6514e2d9-be54-4793-9feb-dcbd6b926656:3320:1874412616897920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787579523.275847:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579523.275913:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616897920 00000100:00100000:2.0:1787579523.275918:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616897920 00010000:00010000:2.0:1787579523.275973:0:14486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ceba319c00/0xb72beeaffa1b7e08 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b7e01 expref: 12 pid: 14495 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579523.276000:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787579523.276008:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6514e2d9-be54-4793-9feb-dcbd6b926656+12:3320:x1874412616897920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787579523.276020:0:14486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579523.276026:0:14486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ceba319c00/0xb72beeaffa1b7e08 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b7e01 expref: 12 pid: 14495 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579523.276037:0:14486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ceba319c00/0xb72beeaffa1b7e08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b7e01 expref: 12 pid: 14495 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579523.276059:0:14486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0ce90a8a800/0xb72beeaffa1b7e47 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579523.276067:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce90a8a800/0xb72beeaffa1b7e47 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579523.276084:0:14486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0ce90a8a800/0xb72beeaffa1b7e47 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579523.276091:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0ce90a8a800/0xb72beeaffa1b7e47 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579523.276098:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0ce90a8a800/0xb72beeaffa1b7e47 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579523.276116:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0ce90a8a800/0xb72beeaffa1b7e47 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579523.276121:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8a800 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579523.276125:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0ce90a8a800/0xb72beeaffa1b7e47 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579523.276132:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0ce90a8a800/0xb72beeaffa1b7e47 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579523.276141:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0ce90a8a800/0xb72beeaffa1b7e47 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579523.276152:0:14486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579523.276191:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6514e2d9-be54-4793-9feb-dcbd6b926656+12:3320:x1874412616897920:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579523.276199:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787579523.276240:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6514e2d9-be54-4793-9feb-dcbd6b926656:3320:1874412616897920:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787579523.276829:0:14932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ceba319c00/0xb72beeaffa1b7e08 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b7e01 expref: 11 pid: 14495 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579523.276848:0:14932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab6ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14932:1874412616897792:0@lo:104: 00010000:00010000:3.0:1787579523.276868:0:14932:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0ce90a8a800/0xb72beeaffa1b7e47 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579523.276878:0:14932:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0ce90a8a800/0xb72beeaffa1b7e47 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579523.276884:0:14932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0ce90a8a800/0xb72beeaffa1b7e47 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579523.276906:0:14932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce90a8a800/0xb72beeaffa1b7e47 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787579523.552708:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787579523.552718:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787579523.552721:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787579523.552724:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787579523.552805:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874412616898048:0@lo:400:kworker.0 00000100:00100000:1.0:1787579523.552911:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579523.553013:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616898048 00000100:00100000:1.0:1787579523.553022:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616898048 00000100:00100000:1.0:1787579523.553075:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787579523.553085:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874412616898048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579523.553141:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874412616898048:12345-0@lo:400:kworker.0 Request processed in 57us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579523.553164:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787579523.553226:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0ceb4688000 x1874412616898048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579523.553242:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874412616898048:0@lo:400:kworker.0 00000100:00100000:2.0:1787579523.557402:0:3318:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787579513/real 1787579513] req@ffffa0ceb480f480 x1874412616894976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787579523 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579523.557446:0:3318:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0ceb480f480 x1874412616894976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787579523 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579523.557458:0:3318:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787579513/real 1787579513] req@ffffa0ceb46b6300 x1874412616894848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787579523 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579523.557472:0:3318:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0ceb46b6300 x1874412616894848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787579523 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787579523.557512:0:3318:0:(import.c:65:import_set_state_nolock()) ffffa0ce9185c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787579523.557524:0:3318:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787579523.557529:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616894976:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787579523.557535:0:3318:0:(import.c:65:import_set_state_nolock()) ffffa0ce9185d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787579523.557540:0:3318:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787579523.557543:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616894848:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787579523.557952:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787579523.557957:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787579523.557960:0:479:0:(import.c:65:import_set_state_nolock()) ffffa0ce9185d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787579523.557966:0:479:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 449 00000100:00080000:1.0:1787579523.557972:0:479:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787579523.557978:0:479:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa0ce9185d000 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:1.0:1787579523.558028:0:479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ceb4688000 x1874412616898176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787579523.558048:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787579523.558051:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787579523.558053:0:479:0:(import.c:65:import_set_state_nolock()) ffffa0ce9185c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787579523.558056:0:479:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 449 00000100:00080000:1.0:1787579523.558058:0:479:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787579523.558062:0:479:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0ce9185c800 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:1.0:1787579523.558083:0:479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ceb4689180 x1874412616898304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787579523.558990:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616898176:0@lo:8:kworker.0 00000400:00000100:2.0:1787579523.559074:0:3318:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874412616898176 offset 0 length 520: 4 00000100:00100000:2.0:1787579523.559147:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616898304:0@lo:8:kworker.0 00000400:00000100:2.0:1787579523.559185:0:3318:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874412616898304 offset 0 length 520: 4 00010000:00010000:0.0:1787579523.875848:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787579524.388390:0:14497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787579524.388399:0:14497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0ce91c07000 from 10 10000000:01000000:0.0:1787579524.388406:0:14497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787579524.388468:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8600/0xb72beeaffa1b7e4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579524.388481:0:14497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8600/0xb72beeaffa1b7e4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579524.388494:0:14497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8600/0xb72beeaffa1b7e4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579524.388525:0:14497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616898432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787579524.388608:0:14497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579524.388673:0:14497:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb1c51000 going to sleep for 11 seconds 00000100:00100000:3.0:1787579524.389205:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616898432 00000100:00100000:3.0:1787579524.389216:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616898432 00000100:00100000:3.0:1787579524.389283:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787579524.389295:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf63ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+11:14497:x1874412616898432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787579524.389313:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579524.389332:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce90a8a800/0xb72beeaffa1b7e55 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b7e4e expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579524.389360:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce90a8a800/0xb72beeaffa1b7e55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b7e4e expref: 12 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579524.389387:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce90a8a800/0xb72beeaffa1b7e55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b7e4e expref: 12 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579524.389398:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce90a8a800, rc 0) 00000100:00100000:3.0:1787579524.389463:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf63ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+12:14497:x1874412616898432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579524.389471:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787579524.391210:0:14497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616898432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787579524.391240:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8600/0xb72beeaffa1b7e4e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7e55 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579524.391252:0:14497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8600/0xb72beeaffa1b7e4e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b7e55 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579524.391339:0:14497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616898560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579524.391409:0:14497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579524.391445:0:14497:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb1c51000 going to sleep for 11 seconds 00000100:00100000:0.0:1787579524.391467:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616898560 00000100:00100000:0.0:1787579524.391473:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616898560 00000100:00100000:0.0:1787579524.391514:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787579524.391523:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf63e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+12:14497:x1874412616898560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579524.391825:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf63e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+12:14497:x1874412616898560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 302us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579524.391834:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787579524.391877:0:14497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616898560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579524.391907:0:14497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616898688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787579524.391975:0:14497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579524.391990:0:14497:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb1c51000 going to sleep for 11 seconds 00000100:00100000:3.0:1787579524.392575:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616898688 00000100:00100000:3.0:1787579524.392582:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616898688 00000100:00100000:3.0:1787579524.392627:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787579524.392637:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf63f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+12:14497:x1874412616898688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787579524.392834:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf63f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+12:14497:x1874412616898688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 198us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579524.392851:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787579524.392896:0:14497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616898688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787579524.393738:0:14956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787579524.393801:0:14497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787579524.393822:0:14497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787579524.393835:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8600/0xb72beeaffa1b7e4e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7e55 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579524.393847:0:14497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8600/0xb72beeaffa1b7e4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7e55 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579524.896641:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787579525.666239:0:14534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787579525.925998:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579526.970686:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579528.052736:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787579528.672416:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787579528.672423:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787579528.672426:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787579528.672429:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787579528.672471:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3322:1874412616898944:0@lo:400:kworker.0 00000100:00100000:3.0:1787579528.672529:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579528.672577:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787579528.672585:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6514e2d9-be54-4793-9feb-dcbd6b926656:3322:1874412616898816:0@lo:400:kworker.0 00000100:00100000:3.0:1787579528.672613:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579528.672658:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616898944 00000100:00100000:3.0:1787579528.672665:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616898944 00000100:00100000:3.0:1787579528.672705:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787579528.672718:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1874412616898944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579528.672766:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1874412616898944:12345-0@lo:400:kworker.0 Request processed in 49us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579528.672774:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787579528.672796:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616898816 00000100:00100000:3.0:1787579528.672800:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616898816 00000100:00100000:3.0:1787579528.672823:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787579528.672829:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf63e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+12:3322:x1874412616898816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579528.672857:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf63e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+12:3322:x1874412616898816:12345-0@lo:400:kworker.0 Request processed in 28us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579528.672864:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787579528.672949:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6514e2d9-be54-4793-9feb-dcbd6b926656:3322:1874412616898816:0@lo:400:kworker.0 00010000:00080000:3.0:1787579528.672965:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0cebab6a680 x1874412616898944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579528.672978:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3322:1874412616898944:0@lo:400:kworker.0 00010000:00010000:0.0:1787579529.056086:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579530.083399:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579531.108505:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579532.132766:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787579532.236891:0:15182:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787579532.236897:0:15182:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787579532.237021:0:15182:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa0ceb3e15000 00000020:01000004:2.0:1787579532.237038:0:15182:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787579532.237049:0:15182:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787579532.237061:0:15182:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffffa0ce867499b8) 00000020:00000080:2.0:1787579532.237077:0:15182:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787579532.305753:0:15182:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787579532.309922:0:15182:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787579532.310867:0:15182:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787579532.314413:0:15182:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1787579532.314656:0:15182:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1787579532.318416:0:15182:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 573: rc = 0 00100000:10000000:1.0:1787579532.318534:0:15182:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 573: rc = 0 00100000:10000000:1.0:1787579532.318639:0:15182:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 573: rc = 0 00100000:10000000:1.0:1787579532.323642:0:15182:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 436: rc = 0 00100000:10000000:1.0:1787579532.324451:0:15182:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 436: rc = 0 00100000:10000000:1.0:1787579532.324743:0:15182:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 436: rc = 0 00100000:10000000:1.0:1787579532.325119:0:15182:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 436: rc = 0 00100000:10000000:1.0:1787579532.325354:0:15182:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 436: rc = 0 00100000:10000000:1.0:1787579532.325582:0:15182:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 436: rc = 0 00000020:00000080:1.0:1787579532.326221:0:15182:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787579532.326231:0:15182:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787579532.326241:0:15182:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb72beeaffa1b7e63 00000020:01000004:1.0:1787579532.326248:0:15182:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1787579532.326266:0:15182:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.153@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787579532.326269:0:15182:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787579532.326275:0:15182:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787579532.326279:0:15182:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787579532.326290:0:15182:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffffa0ceb44a99b8) 00000020:00000080:1.0:1787579532.329346:0:15182:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1787579532.352127:0:15182:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787579532.352313:0:15182:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787579532.352320:0:15182:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787579532.356132:0:15182:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787579532.356142:0:15182:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787579532.357616:0:15182:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787579532.357626:0:15182:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787579532.360730:0:15182:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787579532.360898:0:15182:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787579532.360904:0:15182:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787579532.371980:0:15182:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787579532.371998:0:15182:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787579532.419056:0:15182:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787579532.420019:0:15182:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787579532.420027:0:15182:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787579532.423980:0:15182:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787579532.423994:0:15182:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787579532.426576:0:15182:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787579532.426590:0:15182:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787579532.437224:0:15182:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787579532.437430:0:15182:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787579532.437437:0:15182:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787579532.442102:0:15182:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787579532.442118:0:15182:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787579532.571875:0:15182:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787579532.572078:0:15182:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787579532.572084:0:15182:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787579532.576420:0:15182:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787579532.576434:0:15182:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787579532.578841:0:15182:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787579532.578867:0:15182:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787579532.578873:0:15182:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.153@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787579532.600579:0:15182:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.153@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787579532.600626:0:15182:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.153@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787579532.600631:0:15182:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787579532.600632:0:15182:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787579532.600634:0:15182:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787579532.600635:0:15182:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787579532.600636:0:15182:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787579532.600637:0:15182:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787579532.600638:0:15182:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787579532.600640:0:15182:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787579532.600641:0:15182:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787579532.600644:0:15182:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787579532.600646:0:15182:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787579532.600647:0:15182:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787579532.600648:0:15182:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787579532.600649:0:15182:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787579532.600650:0:15182:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787579532.600651:0:15182:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787579532.600652:0:15182:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787579532.600714:0:15182:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787579532.600715:0:15182:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787579532.600739:0:15182:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787579532.600757:0:15182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4688a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616899072:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787579532.601280:0:15182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579532.601429:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616899072 00000100:00100000:0.0:1787579532.601437:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616899072 00000100:00100000:0.0:1787579532.601489:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787579532.601498:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf63f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+12:15182:x1874412616899072:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787579532.601525:0:14494:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787579532.601528:0:14494:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787579532.601532:0:14494:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787579532.601586:0:15182:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9191e780 going to sleep for 11 seconds 00000100:00100000:0.0:1787579532.610706:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf63f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+12:15182:x1874412616899072:12345-0@lo:253:mount.lustre.0 Request processed in 9202us (9420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579532.610720:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787579532.611097:0:15182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4688a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616899072:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787579532.611121:0:15182:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787579532.611125:0:15182:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787579532.611140:0:15182:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787579532.611141:0:15182:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787579532.611143:0:15182:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787579532.611144:0:15182:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787579532.611145:0:15182:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787579532.611146:0:15182:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787579532.611148:0:15182:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787579532.611149:0:15182:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787579532.611169:0:15182:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0ceb3e15000 from lustre-OST0000 10000000:01000000:1.0:1787579532.611194:0:15182:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787579532.611197:0:15182:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787579532.611203:0:15182:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa0ceb485cd28 local copy 00010000:00010000:1.0:1787579532.611213:0:15182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce90a8b600/0xb72beeaffa1b7d59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7d60 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579532.611448:0:15182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4688a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616899200:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787579532.611484:0:15182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579532.611521:0:15182:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9191e300 going to sleep for 11 seconds 00000100:00100000:3.0:1787579532.611584:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616899200 00000100:00100000:3.0:1787579532.611590:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616899200 00000100:00100000:3.0:1787579532.611620:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787579532.611628:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3d41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+12:15182:x1874412616899200:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787579532.611790:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3d41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+12:15182:x1874412616899200:12345-0@lo:501:mount.lustre.0 Request processed in 162us (305us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787579532.612013:0:15182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4688a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616899200:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787579532.612025:0:15182:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787579532.612166:0:15182:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787579532.612173:0:15182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce90a8b600/0xb72beeaffa1b7d59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7d60 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579532.612182:0:15182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce90a8b600/0xb72beeaffa1b7d59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7d60 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579532.612204:0:15182:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0ceb3e15000 10000000:01000000:1.0:1787579532.612208:0:15182:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787579532.612212:0:15182:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffffa0ceb485cd28 10000000:01000000:1.0:1787579532.612214:0:15182:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787579532.612221:0:15182:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffffa0ceb485cd28 from 1 10000000:01000000:1.0:1787579532.612224:0:15182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787579532.612245:0:15182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c9200/0xb72beeaffa1b7e71 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579532.612253:0:15182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c9200/0xb72beeaffa1b7e71 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579532.612263:0:15182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c9200/0xb72beeaffa1b7e71 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579532.612275:0:15182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4688a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616899328:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787579532.612338:0:15182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579532.612359:0:15182:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9191e300 going to sleep for 11 seconds 00000100:00100000:3.0:1787579532.612417:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787579532.612439:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616899328 00000100:00100000:3.0:1787579532.612442:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616899328 00000100:00100000:3.0:1787579532.612457:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787579532.612463:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3d42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+12:15182:x1874412616899328:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787579532.612470:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579532.612481:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce90a8a000/0xb72beeaffa1b7e78 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b7e71 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579532.612499:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce90a8a000/0xb72beeaffa1b7e78 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b7e71 expref: 13 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579532.612508:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce90a8a000/0xb72beeaffa1b7e78 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b7e71 expref: 13 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579532.612516:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce90a8a000, rc 0) 00000100:00100000:3.0:1787579532.612551:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3d42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+13:15182:x1874412616899328:12345-0@lo:101:mount.lustre.0 Request processed in 88us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579532.612556:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787579532.613020:0:15182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4688a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616899328:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787579532.613033:0:15182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c9200/0xb72beeaffa1b7e71 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7e78 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579532.613042:0:15182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c9200/0xb72beeaffa1b7e71 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b7e78 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579532.613057:0:15182:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787579532.613072:0:15182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c9200/0xb72beeaffa1b7e71 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7e78 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579532.613079:0:15182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c9200/0xb72beeaffa1b7e71 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7e78 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579532.613085:0:15182:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787579532.613096:0:15182:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787579532.613110:0:15182:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787579532.613112:0:15182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787579532.613128:0:15182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c8e00/0xb72beeaffa1b7e7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579532.613136:0:15182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c8e00/0xb72beeaffa1b7e7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579532.613142:0:15182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c8e00/0xb72beeaffa1b7e7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579532.613154:0:15182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4688a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616899456:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787579532.613190:0:15182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579532.613209:0:15182:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9191e300 going to sleep for 11 seconds 00000100:00100000:0.0:1787579532.613364:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616899456 00000100:00100000:0.0:1787579532.613369:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616899456 00000100:00100000:0.0:1787579532.613405:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787579532.613412:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3d42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+13:15182:x1874412616899456:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787579532.613420:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579532.613429:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceba3c8a00/0xb72beeaffa1b7e86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b7e7f expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579532.613443:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceba3c8a00/0xb72beeaffa1b7e86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b7e7f expref: 14 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579532.613450:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceba3c8a00/0xb72beeaffa1b7e86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b7e7f expref: 14 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579532.613456:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c8a00, rc 0) 00000100:00100000:0.0:1787579532.613502:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3d42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+14:15182:x1874412616899456:12345-0@lo:101:mount.lustre.0 Request processed in 91us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579532.613509:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787579532.613583:0:15182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4688a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616899456:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787579532.613593:0:15182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c8e00/0xb72beeaffa1b7e7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7e86 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579532.613601:0:15182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c8e00/0xb72beeaffa1b7e7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b7e86 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787579532.614534:0:15182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787579532.616324:0:15182:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787579532.616577:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787579532.619380:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787579532.619488:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787579532.619560:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787579532.619596:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787579532.623449:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787579532.623581:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787579532.623590:0:15182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787579532.624385:0:15182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616899584:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787579532.624449:0:15182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579532.624533:0:15182:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb1c516c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787579532.627437:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616899584 00000100:00100000:2.0:1787579532.627449:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616899584 00000100:00100000:0.0:1787579532.627572:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787579532.627584:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3d40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+14:15182:x1874412616899584:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787579532.628489:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3d40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+14:15182:x1874412616899584:12345-0@lo:501:mount.lustre.0 Request processed in 904us (4037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579532.628498:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787579532.629216:0:15182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616899584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787579532.629266:0:15182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616899712:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787579532.629316:0:15182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579532.629364:0:15182:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9191e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787579532.629421:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616899712 00000100:00100000:0.0:1787579532.629427:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616899712 00000100:00100000:0.0:1787579532.629465:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787579532.629473:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+14:15182:x1874412616899712:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787579532.630070:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+14:15182:x1874412616899712:12345-0@lo:503:mount.lustre.0 Request processed in 597us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579532.630078:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787579532.630216:0:15182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616899712:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787579532.631476:0:15182:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787579532.631553:0:15182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616899840:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787579532.631625:0:15182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579532.631767:0:15182:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb1cb30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787579532.633305:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616899840 00000100:00100000:2.0:1787579532.633316:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616899840 00000100:00100000:2.0:1787579532.633378:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787579532.633387:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3d40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+14:15182:x1874412616899840:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787579532.633640:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3d40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+14:15182:x1874412616899840:12345-0@lo:502:mount.lustre.0 Request processed in 254us (2027us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579532.633648:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787579532.634083:0:15182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616899840:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787579532.634409:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787579532.634460:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787579532.634492:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787579532.634541:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787579532.634583:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787579532.634648:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787579532.634774:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787579532.635287:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787579532.635343:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1787579532.635400:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1787579532.635439:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1787579532.635507:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1787579532.635549:0:15182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616899968:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787579532.641454:0:15182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579532.641517:0:15182:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce919d8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787579532.641745:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616899968 00000100:00100000:1.0:1787579532.641753:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616899968 00000100:00100000:1.0:1787579532.641855:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787579532.641866:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+14:15182:x1874412616899968:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787579532.642141:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+14:15182:x1874412616899968:12345-0@lo:502:mount.lustre.0 Request processed in 276us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579532.642149:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787579532.642310:0:15182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616899968:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787579532.642421:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1787579532.642441:0:15182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1787579532.653270:0:15197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787579532.653281:0:15197:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787579532.653287:0:15197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579532.653290:0:15197:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787579532.653304:0:15197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787579532.653319:0:15197:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffffa0cec1bf4d28) 00000020:00000080:3.0:1787579532.653349:0:15197:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787579532.653356:0:15197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787579532.653435:0:15197:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0ceb3e15000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787579532.653459:0:15197:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787579532.653476:0:15197:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb72beeaffa1b7e94 00010000:00010000:3.0:1787579532.666891:0:15197:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1787579532.667299:0:15197:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1787579532.672452:0:15197:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787579532.682645:0:15197:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787579532.682657:0:15197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787579532.682664:0:15197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579532.682666:0:15197:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787579532.682670:0:15197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787579532.682672:0:15197:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1787579532.682674:0:15197:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787579532.682675:0:15197:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787579532.682676:0:15197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787579532.682679:0:15197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579532.682680:0:15197:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787579532.682683:0:15197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787579532.682685:0:15197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579532.682687:0:15197:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787579532.682689:0:15197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787579532.682691:0:15197:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787579532.682693:0:15197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787579532.682695:0:15197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579532.682696:0:15197:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787579532.682698:0:15197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787579532.682700:0:15197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579532.682701:0:15197:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787579532.682704:0:15197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787579532.682765:0:15197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787579532.682768:0:15197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579532.682769:0:15197:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787579532.682772:0:15197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1787579532.690249:0:15182:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787579532.690304:0:15182:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787579532.690340:0:15182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c8e00/0xb72beeaffa1b7e7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7e86 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579532.690353:0:15182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c8e00/0xb72beeaffa1b7e7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7e86 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579532.690387:0:15182:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0ceb3e15000 from 1 10000000:01000000:1.0:1787579532.690397:0:15182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787579532.690437:0:15182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c8000/0xb72beeaffa1b7e9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579532.690461:0:15182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c8000/0xb72beeaffa1b7e9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579532.690472:0:15182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c8000/0xb72beeaffa1b7e9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579532.690494:0:15182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616900096:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787579532.690585:0:15182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579532.691269:0:15182:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9191e480 going to sleep for 11 seconds 00000100:00100000:3.0:1787579532.691387:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616900096 00000100:00100000:3.0:1787579532.691395:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616900096 00000100:00100000:3.0:1787579532.691649:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787579532.691666:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+14:15182:x1874412616900096:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787579532.691697:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579532.691710:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ce90a8b800/0xb72beeaffa1b7ea2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b7e9b expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579532.691743:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ce90a8b800/0xb72beeaffa1b7ea2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b7e9b expref: 15 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579532.691759:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ce90a8b800/0xb72beeaffa1b7ea2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b7e9b expref: 15 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579532.691770:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ce90a8b800, rc 0) 00000100:00100000:3.0:1787579532.692044:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+15:15182:x1874412616900096:12345-0@lo:101:mount.lustre.0 Request processed in 378us (1458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579532.692051:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787579532.692140:0:15182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616900096:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787579532.692156:0:15182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c8000/0xb72beeaffa1b7e9b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7ea2 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579532.692166:0:15182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c8000/0xb72beeaffa1b7e9b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b7ea2 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787579532.693477:0:15182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787579532.693897:0:15182:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787579532.694192:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787579532.694234:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787579532.694287:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787579532.694294:0:15182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787579532.694367:0:15182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616900224:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787579532.694418:0:15182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579532.695088:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616900224 00000100:00100000:0.0:1787579532.695106:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616900224 00000100:00100000:0.0:1787579532.695143:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787579532.695152:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3d41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+15:15182:x1874412616900224:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787579532.695359:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3d41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+15:15182:x1874412616900224:12345-0@lo:501:mount.lustre.0 Request processed in 207us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579532.695367:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787579532.695601:0:15182:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9191e480 going to sleep for 11 seconds 00000100:00100000:1.0:1787579532.695684:0:15182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616900224:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787579532.695723:0:15182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616900352:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787579532.695762:0:15182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579532.696026:0:15182:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9191e480 going to sleep for 11 seconds 00000100:00100000:0.0:1787579532.696150:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616900352 00000100:00100000:0.0:1787579532.696154:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616900352 00000100:00100000:0.0:1787579532.696214:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787579532.696228:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3d40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+15:15182:x1874412616900352:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787579532.696388:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3d40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+15:15182:x1874412616900352:12345-0@lo:503:mount.lustre.0 Request processed in 160us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579532.696395:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787579532.696477:0:15182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616900352:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787579532.697035:0:15182:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787579532.697351:0:15182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616900480:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787579532.697394:0:15182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579532.697586:0:15182:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9191e480 going to sleep for 11 seconds 00000100:00100000:3.0:1787579532.697701:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616900480 00000100:00100000:3.0:1787579532.697713:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616900480 00000100:00100000:3.0:1787579532.697746:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787579532.697753:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3d43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+15:15182:x1874412616900480:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787579532.698189:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3d43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+15:15182:x1874412616900480:12345-0@lo:502:mount.lustre.0 Request processed in 434us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579532.698197:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787579532.698548:0:15182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616900480:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787579532.699269:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787579532.699346:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787579532.699402:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787579532.699442:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787579532.699473:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787579532.699517:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787579532.699548:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787579532.699594:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787579532.699709:0:15182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616900608:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787579532.699776:0:15182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579532.700176:0:15182:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9191e480 going to sleep for 11 seconds 00000100:00100000:3.0:1787579532.700219:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616900608 00000100:00100000:3.0:1787579532.700224:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616900608 00000100:00100000:3.0:1787579532.700297:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787579532.700306:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3d43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+15:15182:x1874412616900608:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787579532.700546:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3d43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+15:15182:x1874412616900608:12345-0@lo:502:mount.lustre.0 Request processed in 240us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579532.700562:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787579532.700713:0:15182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616900608:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787579532.700816:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787579532.700891:0:15182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787579532.702756:0:15201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787579532.702766:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579532.702768:0:15201:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787579532.702775:0:15201:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0ceb3e15000 00000020:00000080:3.0:1787579532.702778:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787579532.702784:0:15201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787579532.702787:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579532.702789:0:15201:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787579532.702791:0:15201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787579532.702794:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579532.702795:0:15201:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787579532.702798:0:15201:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0ceb3e15000 00000020:00000080:3.0:1787579532.702800:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787579532.703034:0:15201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787579532.703051:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579532.703053:0:15201:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787579532.703056:0:15201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787579532.703059:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579532.703060:0:15201:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787579532.703064:0:15201:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0ceb3e15000 00000020:00000080:3.0:1787579532.703066:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787579532.706692:0:15201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787579532.706705:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579532.706707:0:15201:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787579532.706712:0:15201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787579532.715502:0:15182:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787579532.715536:0:15182:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787579532.715569:0:15182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c8000/0xb72beeaffa1b7e9b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7ea2 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579532.715581:0:15182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c8000/0xb72beeaffa1b7e9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7ea2 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579532.715689:0:15182:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787579532.715693:0:15182:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0ceb3e15000 10000000:01000000:2.0:1787579532.715696:0:15182:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0ceb3e15000 10000000:01000000:2.0:1787579532.715883:0:15182:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787579532.715890:0:15182:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0ceb3e15000 from 1 10000000:01000000:2.0:1787579532.715893:0:15182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787579532.716192:0:15182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba319e00/0xb72beeaffa1b7ea9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579532.716202:0:15182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ceba319e00/0xb72beeaffa1b7ea9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579532.716214:0:15182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ceba319e00/0xb72beeaffa1b7ea9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579532.716237:0:15182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616900736:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787579532.716310:0:15182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579532.716454:0:15182:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fbdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787579532.716802:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616900736 00000100:00100000:0.0:1787579532.716810:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616900736 00000100:00100000:0.0:1787579532.716863:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787579532.716872:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3d43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+15:15182:x1874412616900736:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787579532.716884:0:14494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579532.716898:0:14494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceba3c8c00/0xb72beeaffa1b7eb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b7ea9 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579532.716922:0:14494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceba3c8c00/0xb72beeaffa1b7eb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b7ea9 expref: 16 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579532.716954:0:14494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceba3c8c00/0xb72beeaffa1b7eb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b7ea9 expref: 16 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579532.716964:0:14494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c8c00, rc 0) 00000100:00100000:0.0:1787579532.717009:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3d43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+16:15182:x1874412616900736:12345-0@lo:101:mount.lustre.0 Request processed in 137us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579532.717016:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787579532.717279:0:15182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616900736:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787579532.717294:0:15182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ceba319e00/0xb72beeaffa1b7ea9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7eb0 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579532.717305:0:15182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ceba319e00/0xb72beeaffa1b7ea9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b7eb0 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787579532.717998:0:15182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1787579532.718395:0:15182:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787579532.719179:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787579532.719322:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787579532.719417:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787579532.719484:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787579532.719537:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787579532.719598:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787579532.719648:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787579532.720185:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787579532.720709:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787579532.720773:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787579532.720822:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787579532.720873:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787579532.720909:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787579532.720965:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787579532.721016:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787579532.721052:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787579532.721082:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787579532.721132:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787579532.721164:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787579532.721189:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787579532.721232:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787579532.721278:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787579532.721307:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787579532.721357:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787579532.722051:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787579532.722101:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787579532.722152:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787579532.722188:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787579532.722274:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787579532.722289:0:15182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1787579532.722390:0:15182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616900864:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787579532.722446:0:15182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579532.723221:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616900864 00000100:00100000:3.0:1787579532.723231:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616900864 00000100:00100000:3.0:1787579532.723274:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787579532.723283:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+16:15182:x1874412616900864:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787579532.723342:0:15182:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fbdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787579532.723557:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+16:15182:x1874412616900864:12345-0@lo:501:mount.lustre.0 Request processed in 274us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579532.723570:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787579532.723877:0:15182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616900864:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787579532.723918:0:15182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616900992:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787579532.724005:0:15182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579532.724040:0:15182:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fbdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787579532.724053:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616900992 00000100:00100000:0.0:1787579532.724060:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616900992 00000100:00100000:0.0:1787579532.724101:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787579532.724110:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce85115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+16:15182:x1874412616900992:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787579532.724266:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce85115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+16:15182:x1874412616900992:12345-0@lo:503:mount.lustre.0 Request processed in 157us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579532.724283:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787579532.727705:0:15182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616900992:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787579532.728244:0:15182:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787579532.728459:0:15182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616901120:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787579532.728528:0:15182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579532.728583:0:15182:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fbdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787579532.730841:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616901120 00000100:00100000:0.0:1787579532.730852:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616901120 00000100:00100000:0.0:1787579532.730897:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787579532.730907:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce85114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+16:15182:x1874412616901120:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787579532.734316:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce85114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+16:15182:x1874412616901120:12345-0@lo:502:mount.lustre.0 Request processed in 3402us (5780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579532.734341:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787579532.734781:0:15182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616901120:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787579532.735067:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787579532.735125:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787579532.735160:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787579532.735208:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787579532.735241:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787579532.736897:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787579532.736969:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787579532.737002:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787579532.737047:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787579532.737081:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787579532.738576:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787579532.739834:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787579532.739901:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787579532.741487:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787579532.741594:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787579532.741638:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787579532.741675:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787579532.743547:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787579532.743611:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787579532.743657:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787579532.745492:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787579532.745568:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787579532.745598:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787579532.745648:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787579532.746796:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787579532.746876:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787579532.749175:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787579532.750991:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787579532.751057:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787579532.751116:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787579532.751174:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787579532.751211:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787579532.751244:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787579532.756533:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787579532.756591:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787579532.756644:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787579532.756682:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787579532.757204:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787579532.759443:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787579532.759532:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787579532.759583:0:15182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616901248:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787579532.759657:0:15182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579532.762943:0:15182:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce905c2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787579532.763637:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616901248 00000100:00100000:0.0:1787579532.763647:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616901248 00000100:00100000:0.0:1787579532.763700:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787579532.763711:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce855bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+16:15182:x1874412616901248:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787579532.764167:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce855bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+16:15182:x1874412616901248:12345-0@lo:502:mount.lustre.0 Request processed in 456us (4508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579532.764175:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787579532.770299:0:15182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616901248:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787579532.770455:0:15182:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787579532.770472:0:15182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1787579532.781045:0:15206:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787579532.781060:0:15206:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffffa0cec1bf3370) 00000020:00000080:3.0:1787579532.781080:0:15206:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1787579532.781742:0:15206:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0ceb3e15000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787579532.781748:0:15206:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0ceb3e15000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787579532.781750:0:15206:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0ceb3e15000 3 00010000:00080000:3.0:1787579532.781782:0:15206:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0ceb3138800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.153@tcp at head 00010000:00010000:3.0:1787579532.785071:0:15206:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1787579532.785340:0:15206:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787579532.785379:0:15206:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787579532.785393:0:15206:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xb72beeaffa1b7ebe 00000100:00080000:2.0:1787579532.785403:0:15206:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787579532.785408:0:15206:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa0ceb3138800 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:2.0:1787579532.785440:0:15206:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ceb480ea00 x1874412616901376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787579532.785475:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3318:1874412616901376:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787579532.785540:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579532.785610:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616901376 00000100:00100000:2.0:1787579532.785628:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616901376 00000100:00100000:2.0:1787579532.785658:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787579532.785665:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3318:x1874412616901376:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787579532.785691:0:14502:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:2.0:1787579532.785729:0:14502:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xb72beeaffa1b7ec5 00000004:00100000:2.0:1787579532.785743:0:14502:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787579532.785769:0:14502:0:(import.c:65:import_set_state_nolock()) ffffa0cebf3ea000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787579532.785819:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874412616901376:12345-0@lo:38:llog_process_th.0 Request processed in 153us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579532.785826:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787579532.785857:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0ceb480ea00 x1874412616901376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787579542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579532.785866:0:3318:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787579532.785872:0:3318:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1787579532.785877:0:3318:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787579532.785881:0:3318:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787579532.785883:0:3318:0:(import.c:65:import_set_state_nolock()) ffffa0ceb3138800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787579532.785889:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3318:1874412616901376:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787579532.785904:0:15206:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:2.0:1787579532.788004:0:15206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1787579532.790402:0:15182:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787579532.790440:0:15182:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787579532.790459:0:15182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba319e00/0xb72beeaffa1b7ea9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7eb0 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579532.790471:0:15182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ceba319e00/0xb72beeaffa1b7ea9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7eb0 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787579532.790531:0:15182:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787579532.790533:0:15182:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787579532.790535:0:15182:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787579532.790536:0:15182:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787579532.790537:0:15182:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787579532.790539:0:15182:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787579532.790540:0:15182:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787579532.790542:0:15182:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787579532.790543:0:15182:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787579532.790546:0:15182:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787579532.790549:0:15182:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787579532.790550:0:15182:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787579532.790551:0:15182:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787579532.790552:0:15182:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787579532.790553:0:15182:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787579532.790555:0:15182:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787579532.790556:0:15182:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787579532.790557:0:15182:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787579532.790557:0:15182:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787579532.790584:0:15182:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787579532.790603:0:15182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616901504:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787579532.790678:0:15182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579532.790814:0:15182:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce88314480 going to sleep for 11 seconds 00000100:00100000:0.0:1787579532.790837:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616901504 00000100:00100000:0.0:1787579532.790844:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616901504 00000100:00100000:0.0:1787579532.790887:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787579532.790895:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce855bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+16:15182:x1874412616901504:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787579532.790922:0:14495:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787579532.790960:0:14495:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:2.0:1787579532.793909:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787579532.793917:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787579532.793920:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787579532.793922:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787579532.794002:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787579532.794018:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874412616901632:0@lo:400:kworker.0 00000100:00100000:2.0:1787579532.794091:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579532.795144:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616901632 00000100:00100000:3.0:1787579532.795155:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616901632 00000100:00100000:3.0:1787579532.795214:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787579532.795224:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874412616901632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579532.795305:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874412616901632:12345-0@lo:400:kworker.0 Request processed in 82us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579532.795313:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787579532.795370:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0ceb480ea00 x1874412616901632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579532.795383:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874412616901632:0@lo:400:kworker.0 20000000:01000000:0.0:1787579532.873512:0:14495:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787579532.873532:0:14495:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787579532.873588:0:14516:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787579532.873593:0:14516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787579532.873631:0:14516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0ceba319a00/0xb72beeaffa1b7ecc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579532.873649:0:14516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ceba3c9000/0xb72beeaffa1b7e39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b7e32 expref: 16 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579532.873657:0:14516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0ceba319a00/0xb72beeaffa1b7ecc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579532.873697:0:14516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ceba3c9000/0xb72beeaffa1b7e39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b7e32 expref: 16 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579532.873712:0:14516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0ceba3c9000/0xb72beeaffa1b7e39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b7e32 expref: 16 pid: 14495 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579532.873726:0:14516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14516:1874412616901760:0@lo:104: 00000100:00100000:2.0:1787579532.873782:0:14516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579532.873862:0:14516:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fbd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787579532.874384:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616901760 00000100:00100000:0.0:1787579532.874391:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616901760 00000100:00100000:0.0:1787579532.874508:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787579532.874516:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6514e2d9-be54-4793-9feb-dcbd6b926656+3:14516:x1874412616901760:12345-0@lo:104: 00010000:00010000:0.0:1787579532.874528:0:14484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b7e32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b7e39 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579532.874581:0:14484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787579532.874587:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6514e2d9-be54-4793-9feb-dcbd6b926656+3:14516:x1874412616901760:12345-0@lo:104: Request processed in 72us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579532.874593:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787579532.874629:0:14488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787579532.874635:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b7e32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b7e39 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579532.874643:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba319000 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:0.0:1787579532.874647:0:14488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b7e32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b7e39 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579532.874655:0:14488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b7e32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b7e39 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787579532.874663:0:14488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b7e32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b7e39 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579532.874669:0:14488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787579532.874695:0:14488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b7e32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b7e39 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579532.874702:0:14488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787579532.874719:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b7e32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b7e39 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579532.874748:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ceba319000/0xb72beeaffa1b7e32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b7e39 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579532.874766:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579532.874768:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579532.874770:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579532.874791:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6514e2d9-be54-4793-9feb-dcbd6b926656:3320:1874412616901888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787579532.874962:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579532.875006:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616901888 00000100:00100000:0.0:1787579532.875009:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616901888 00010000:00010000:0.0:1787579532.875023:0:14486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ceba3c9000/0xb72beeaffa1b7e39 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b7e32 expref: 17 pid: 14495 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579532.875045:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787579532.875052:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6514e2d9-be54-4793-9feb-dcbd6b926656+17:3320:x1874412616901888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787579532.875083:0:14486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579532.875089:0:14486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ceba3c9000/0xb72beeaffa1b7e39 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b7e32 expref: 17 pid: 14495 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579532.875162:0:14486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ceba3c9000/0xb72beeaffa1b7e39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b7e32 expref: 17 pid: 14495 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579532.875178:0:14486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0ceba319a00/0xb72beeaffa1b7ecc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579532.875185:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceba319a00/0xb72beeaffa1b7ecc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787579532.875197:0:14486:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003366996s 00010000:00010000:0.0:1787579532.875272:0:14486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0ceba319a00/0xb72beeaffa1b7ecc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579532.875280:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0ceba319a00/0xb72beeaffa1b7ecc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579532.875286:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0ceba319a00/0xb72beeaffa1b7ecc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579532.875292:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0ceba319a00/0xb72beeaffa1b7ecc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579532.875297:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba319a00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:0.0:1787579532.875301:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0ceba319a00/0xb72beeaffa1b7ecc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579532.875308:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0ceba319a00/0xb72beeaffa1b7ecc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579532.875317:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0ceba319a00/0xb72beeaffa1b7ecc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579532.875327:0:14486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579532.875374:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6514e2d9-be54-4793-9feb-dcbd6b926656+17:3320:x1874412616901888:12345-0@lo:103:ldlm_bl.0 Request processed in 321us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579532.875381:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787579532.875493:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6514e2d9-be54-4793-9feb-dcbd6b926656:3320:1874412616901888:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787579532.875525:0:14516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ceba3c9000/0xb72beeaffa1b7e39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b7e32 expref: 16 pid: 14495 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579532.875535:0:14516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14516:1874412616901760:0@lo:104: 00010000:00010000:0.0:1787579532.875551:0:14516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0ceba319a00/0xb72beeaffa1b7ecc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579532.875559:0:14516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0ceba319a00/0xb72beeaffa1b7ecc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579532.875565:0:14516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0ceba319a00/0xb72beeaffa1b7ecc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579532.875570:0:14516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ceba319a00/0xb72beeaffa1b7ecc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579532.945019:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce855bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+15:15182:x1874412616901504:12345-0@lo:253:mount.lustre.0 Request processed in 154117us (154334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579532.945033:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787579532.945179:0:15182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15182:1874412616901504:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787579532.945194:0:15182:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787579532.945197:0:15182:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787579532.945202:0:15182:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787579532.945204:0:15182:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787579532.945205:0:15182:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787579532.945206:0:15182:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787579532.945207:0:15182:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787579532.945209:0:15182:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787579532.945210:0:15182:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787579532.945212:0:15182:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787579532.945226:0:15182:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787579532.950300:0:15182:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787579532.950491:0:15182:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787579532.950779:0:15182:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787579532.951234:0:15182:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787579532.951389:0:15182:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787579532.951573:0:15182:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787579532.952577:0:15182:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787579533.014758:0:15182:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787579533.014765:0:15182:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787579533.014794:0:15182:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787579533.015212:0:15182:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.153@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787579533.015227:0:15182:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787579533.015252:0:15182:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1787579533.153725:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787579533.921866:0:14497:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787579533.921883:0:14497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0ce91c07000 from 7 10000000:01000000:0.0:1787579533.921887:0:14497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787579533.921962:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8000/0xb72beeaffa1b7ed3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579533.921973:0:14497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8000/0xb72beeaffa1b7ed3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579533.921985:0:14497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8000/0xb72beeaffa1b7ed3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579533.922009:0:14497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616902016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787579533.922068:0:14497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579533.922127:0:14497:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fe2780 going to sleep for 11 seconds 00000100:00100000:1.0:1787579533.922556:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616902016 00000100:00100000:1.0:1787579533.922563:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616902016 00000100:00100000:1.0:1787579533.922618:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787579533.922627:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce855b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+15:14497:x1874412616902016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787579533.922639:0:14494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579533.922654:0:14494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceb47c8c00/0xb72beeaffa1b7eda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b7ed3 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579533.922675:0:14494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceb47c8c00/0xb72beeaffa1b7eda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b7ed3 expref: 16 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579533.922684:0:14494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceb47c8c00/0xb72beeaffa1b7eda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b7ed3 expref: 16 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579533.922702:0:14494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceb47c8c00, rc 0) 00000100:00100000:1.0:1787579533.922746:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce855b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+16:14497:x1874412616902016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579533.922753:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787579533.922797:0:14497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616902016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787579533.922811:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8000/0xb72beeaffa1b7ed3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7eda expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579533.922820:0:14497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8000/0xb72beeaffa1b7ed3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b7eda expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579533.922868:0:14497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4689f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616902144:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787579533.922899:0:14497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579533.922919:0:14497:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce8613b600 going to sleep for 11 seconds 00000100:00100000:0.0:1787579533.924398:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616902144 00000100:00100000:0.0:1787579533.924860:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616902144 00000100:00100000:0.0:1787579533.924997:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787579533.925007:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce88252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+16:14497:x1874412616902144:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787579533.925028:0:14492:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787579533.925044:0:14492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787579533.925047:0:14492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787579533.926211:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce88252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+16:14497:x1874412616902144:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1202us (3307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579533.927569:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787579533.928158:0:14497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4689f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616902144:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787579533.928225:0:14497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787579533.928234:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8000/0xb72beeaffa1b7ed3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7eda expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579533.928244:0:14497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8000/0xb72beeaffa1b7ed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7eda expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579534.177152:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579535.203980:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787579535.904626:0:14534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787579536.224130:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579537.251681:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787579537.888852:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787579537.888858:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787579537.888861:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787579537.888871:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787579537.888947:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3322:1874412616902400:0@lo:400:kworker.0 00000100:00100000:1.0:1787579537.889018:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579537.889069:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616902528:0@lo:400:kworker.0 00000100:00100000:0.0:1787579537.889105:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579537.889144:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616902400 00000100:00100000:0.0:1787579537.889152:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616902400 00000100:00100000:1.0:1787579537.889365:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787579537.889372:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6514e2d9-be54-4793-9feb-dcbd6b926656:3322:1874412616902272:0@lo:400:kworker.0 00000100:00100000:1.0:1787579537.889410:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579537.889458:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616902272 00000100:00100000:3.0:1787579537.889464:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616902272 00000100:00100000:3.0:1787579537.889504:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787579537.889513:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce88250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+16:3322:x1874412616902272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579537.889565:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce88250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+16:3322:x1874412616902272:12345-0@lo:400:kworker.0 Request processed in 53us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579537.889572:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787579537.889589:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6514e2d9-be54-4793-9feb-dcbd6b926656:3322:1874412616902272:0@lo:400:kworker.0 00000100:00100000:0.0:1787579537.889866:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616902528 00000100:00100000:0.0:1787579537.889871:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616902528 00000100:00100000:0.0:1787579537.891261:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787579537.891277:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1874412616902400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579537.891356:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1874412616902400:12345-0@lo:400:kworker.0 Request processed in 85us (2337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579537.891364:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787579537.891379:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787579537.891385:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616902528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579537.891411:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616902528:12345-0@lo:400:kworker.0 Request processed in 27us (2306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579537.891417:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787579537.891465:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ceb468bb80 x1874412616902528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579537.891478:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616902528:0@lo:400:kworker.0 00010000:00080000:0.0:1787579537.891574:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ceb4688e00 x1874412616902400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579537.891585:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3322:1874412616902400:0@lo:400:kworker.0 00000100:00080000:0.0:1787579537.891624:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787579538.274040:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579538.914921:0:3318:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787579523/real 1787579523] req@ffffa0ceb4688000 x1874412616898176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787579538 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579538.914973:0:3318:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0ceb4688000 x1874412616898176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787579538 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579538.914983:0:3318:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787579523/real 1787579523] req@ffffa0ceb4689180 x1874412616898304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787579538 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579538.915012:0:3318:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0ceb4689180 x1874412616898304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787579538 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787579538.915032:0:3318:0:(import.c:65:import_set_state_nolock()) ffffa0ce9185d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787579538.915109:0:3318:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787579538.915114:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616898176:0@lo:8:kworker.0 00000100:00080000:3.0:1787579538.915120:0:3318:0:(import.c:65:import_set_state_nolock()) ffffa0ce9185c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787579538.929538:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787579538.929545:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787579538.929548:0:36:0:(import.c:65:import_set_state_nolock()) ffffa0ce9185d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787579538.929557:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 459 00000100:00080000:0.0:1787579538.929562:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787579538.929568:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa0ce9185d000 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:0.0:1787579538.929588:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ceb46b5c00 x1874412616902784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787579538.929600:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787579538.929603:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787579538.929605:0:36:0:(import.c:65:import_set_state_nolock()) ffffa0ce9185c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787579538.929608:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 459 00000100:00080000:0.0:1787579538.929610:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787579538.929614:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0ce9185c800 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:0.0:1787579538.929624:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ceb46b4a80 x1874412616902912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787579538.929700:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6514e2d9-be54-4793-9feb-dcbd6b926656:3320:1874412616902656:0@lo:400:kworker.0 00000100:00100000:0.0:1787579538.929760:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579538.929815:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616903040:0@lo:400:kworker.0 00000100:00100000:0.0:1787579538.929854:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579538.929875:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787579538.929880:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616903168:0@lo:400:kworker.0 00000100:00100000:0.0:1787579538.929899:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579538.929942:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616902656 00000100:00100000:0.0:1787579538.929948:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616902656 00000100:00100000:0.0:1787579538.929985:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787579538.929993:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce88253050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+16:3320:x1874412616902656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579538.930034:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce88253050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+16:3320:x1874412616902656:12345-0@lo:400:kworker.0 Request processed in 42us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579538.930041:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787579538.930071:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616903040 00000100:00100000:0.0:1787579538.930075:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616903040 00000100:00100000:0.0:1787579538.930097:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616903168 00000100:00100000:0.0:1787579538.930100:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616903168 00000100:00100000:0.0:1787579538.930113:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787579538.930119:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616903040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579538.930150:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616903040:12345-0@lo:400:kworker.0 Request processed in 31us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579538.930156:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787579538.930168:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787579538.930175:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616903168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579538.930212:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616903168:12345-0@lo:400:kworker.0 Request processed in 38us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579538.930218:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787579538.930258:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ceb46b5f80 x1874412616903168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579538.930270:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616903168:0@lo:400:kworker.0 00010000:00080000:0.0:1787579538.930281:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ceb46b7100 x1874412616903040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579538.930289:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616903040:0@lo:400:kworker.0 00000100:00100000:0.0:1787579538.930329:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6514e2d9-be54-4793-9feb-dcbd6b926656:3320:1874412616902656:0@lo:400:kworker.0 00000100:00080000:3.0:1787579538.930730:0:3318:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787579538.930736:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616898304:0@lo:8:kworker.0 00000100:00100000:3.0:1787579538.930754:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616902784:0@lo:8:kworker.0 00000100:00100000:3.0:1787579538.930786:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579538.930818:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616902912:0@lo:8:kworker.0 00000100:00100000:3.0:1787579538.930858:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579538.930958:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616902784 00000100:00100000:1.0:1787579538.930963:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616902784 00000100:00100000:1.0:1787579538.930991:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616902912 00000100:00100000:1.0:1787579538.930994:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616902912 00000100:00100000:1.0:1787579538.931006:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787579538.931012:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3318:x1874412616902784:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787579538.931033:0:15185:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:1.0:1787579538.931074:0:15185:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb72beeaffa1b7ee1 00002000:00100000:1.0:1787579538.931086:0:15185:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffffa0ce90458000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787579538.931091:0:15185:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787579538.931094:0:15185:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787579538.931449:0:15185:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787579538.931470:0:15185:0:(import.c:65:import_set_state_nolock()) ffffa0ce9045b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787579538.931522:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3318:x1874412616902784:12345-0@lo:8:kworker.0 Request processed in 508us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579538.931529:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787579538.931544:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787579538.931548:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3318:x1874412616902912:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787579538.931570:0:15185:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1787579538.933841:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ceb46b5c00 x1874412616902784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787579558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579538.933856:0:3318:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787579538.933865:0:3318:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787579538.933873:0:3318:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787579538.933879:0:3318:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787579538.933882:0:3318:0:(import.c:65:import_set_state_nolock()) ffffa0ce9185d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787579538.933899:0:3318:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787579538.933905:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616902784:0@lo:8:kworker.0 00000004:00080000:3.0:1787579538.933991:0:14523:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1787579538.934008:0:14523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab69880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14523:1874412616903424:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787579538.934069:0:14523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579538.934093:0:14523:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fe2180 going to sleep for 11 seconds 00000004:00080000:3.0:1787579538.934107:0:14522:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787579538.938891:0:14522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 475129962064ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787579538.938952:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616903296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787579538.939017:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579538.939082:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616903296 00000100:00100000:3.0:1787579538.939089:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616903296 00000100:00100000:3.0:1787579538.939144:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787579538.939154:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1874412616903296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787579538.939187:0:15188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787579538.939242:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1874412616903296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579538.939249:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787579538.939276:0:15187:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787579538.939283:0:15187:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:3.0:1787579538.939410:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0cebab6b800 x1874412616903296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579554 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579538.939430:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616903296:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787579538.940823:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787579538.940869:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616903424 00000100:00100000:0.0:1787579538.940878:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616903424 00000100:00100000:0.0:1787579538.941008:0:15485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787579538.941019:0:15485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14523:x1874412616903424:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787579538.968812:0:15485:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787579538.968821:0:15485:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1787579538.968839:0:15485:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00100000:1.0:1787579538.995798:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3318:x1874412616902912:12345-0@lo:8:kworker.0 Request processed in 64242us (64932us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787579538.995812:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787579538.996156:0:3318:0:(import.c:65:import_set_state_nolock()) ffffa0ce9185c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787579538.996163:0:3318:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787579538.996168:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616902912:0@lo:8:kworker.0 00002000:00010000:0.0:1787579539.058161:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787579539.058174:0:15485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2594847/0xb72beeaffa1b7ee8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.058190:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1787579539.058194:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787579539.058201:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2594847/0xb72beeaffa1b7ee8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.058230:0:15485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2594847/0xb72beeaffa1b7ee8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.058240:0:15485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2594847/0xb72beeaffa1b7ee8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.058247:0:15485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2594847/0xb72beeaffa1b7ee8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.058274:0:15485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787579539.060870:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787579539.060883:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2594847/0xb72beeaffa1b7ee8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.060896:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8400 already unused, calling callback (ffffffffc1654230) 00010000:00010000:1.0:1787579539.060901:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2594847/0xb72beeaffa1b7ee8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.060912:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2594847/0xb72beeaffa1b7ee8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.060958:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2594847/0xb72beeaffa1b7ee8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.060967:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2594847/0xb72beeaffa1b7ee8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.060997:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579539.061000:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579539.061002:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787579539.067664:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787579539.067676:0:15485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d1d7326/0xb72beeaffa1b7eef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.067691:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1787579539.067696:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787579539.067702:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d1d7326/0xb72beeaffa1b7eef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.067714:0:15485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d1d7326/0xb72beeaffa1b7eef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.067724:0:15485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d1d7326/0xb72beeaffa1b7eef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.067743:0:15485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d1d7326/0xb72beeaffa1b7eef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.067772:0:15485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787579539.068263:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787579539.068270:0:15485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006609d45b/0xb72beeaffa1b7ef6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.068279:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1787579539.068282:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787579539.068287:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006609d45b/0xb72beeaffa1b7ef6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.068309:0:15485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006609d45b/0xb72beeaffa1b7ef6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.068317:0:15485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006609d45b/0xb72beeaffa1b7ef6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.068325:0:15485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006609d45b/0xb72beeaffa1b7ef6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.068341:0:15485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787579539.068353:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787579539.068358:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d1d7326/0xb72beeaffa1b7eef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.068372:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9000 already unused, calling callback (ffffffffc1654230) 00010000:00010000:0.0:1787579539.068377:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d1d7326/0xb72beeaffa1b7eef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.068387:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d1d7326/0xb72beeaffa1b7eef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.068403:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d1d7326/0xb72beeaffa1b7eef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.068579:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d1d7326/0xb72beeaffa1b7eef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.068599:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787579539.068603:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006609d45b/0xb72beeaffa1b7ef6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.068610:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9600 already unused, calling callback (ffffffffc1654230) 00010000:00010000:0.0:1787579539.068613:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006609d45b/0xb72beeaffa1b7ef6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.068621:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006609d45b/0xb72beeaffa1b7ef6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.068632:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006609d45b/0xb72beeaffa1b7ef6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.068645:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006609d45b/0xb72beeaffa1b7ef6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.068657:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579539.068659:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579539.068661:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787579539.069205:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787579539.069212:0:15485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e634883b/0xb72beeaffa1b7efd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.069220:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1787579539.069224:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787579539.069228:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e634883b/0xb72beeaffa1b7efd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.069238:0:15485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e634883b/0xb72beeaffa1b7efd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.069246:0:15485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e634883b/0xb72beeaffa1b7efd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.069253:0:15485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e634883b/0xb72beeaffa1b7efd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.069268:0:15485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787579539.069277:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787579539.069287:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e634883b/0xb72beeaffa1b7efd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.069308:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9e00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:0.0:1787579539.069312:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e634883b/0xb72beeaffa1b7efd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.069319:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e634883b/0xb72beeaffa1b7efd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.069331:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e634883b/0xb72beeaffa1b7efd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.069339:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e634883b/0xb72beeaffa1b7efd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.069355:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579539.069579:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579539.069582:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579539.069952:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787579539.070075:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787579539.070081:0:15485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003640667c/0xb72beeaffa1b7f04 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.070089:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1787579539.070092:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787579539.070096:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003640667c/0xb72beeaffa1b7f04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.070116:0:15485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003640667c/0xb72beeaffa1b7f04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.070125:0:15485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003640667c/0xb72beeaffa1b7f04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.070132:0:15485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003640667c/0xb72beeaffa1b7f04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579539.070154:0:15485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787579539.070748:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787579539.070754:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003640667c/0xb72beeaffa1b7f04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.070769:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9c00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:1.0:1787579539.070773:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003640667c/0xb72beeaffa1b7f04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.070781:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003640667c/0xb72beeaffa1b7f04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.070795:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003640667c/0xb72beeaffa1b7f04 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.070803:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003640667c/0xb72beeaffa1b7f04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.070820:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579539.070822:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579539.070824:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787579539.075129:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579539.075142:0:15485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009337a908/0xb72beeaffa1b7f0b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.075159:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1787579539.075164:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579539.075169:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009337a908/0xb72beeaffa1b7f0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.075183:0:15485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009337a908/0xb72beeaffa1b7f0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.075201:0:15485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009337a908/0xb72beeaffa1b7f0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.075209:0:15485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009337a908/0xb72beeaffa1b7f0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.075228:0:15485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787579539.075243:0:14488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787579539.075332:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009337a908/0xb72beeaffa1b7f0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.075344:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c8200 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579539.075349:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009337a908/0xb72beeaffa1b7f0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.075368:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009337a908/0xb72beeaffa1b7f0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.075389:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009337a908/0xb72beeaffa1b7f0b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.075398:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009337a908/0xb72beeaffa1b7f0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.075568:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579539.075570:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579539.075572:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787579539.077897:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579539.077908:0:15485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000524d8183/0xb72beeaffa1b7f12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.077921:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1787579539.078009:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579539.078017:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000524d8183/0xb72beeaffa1b7f12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.078033:0:15485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000524d8183/0xb72beeaffa1b7f12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.078043:0:15485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000524d8183/0xb72beeaffa1b7f12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.078051:0:15485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000524d8183/0xb72beeaffa1b7f12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.078086:0:15485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787579539.078388:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787579539.078395:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000524d8183/0xb72beeaffa1b7f12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.078405:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c9e00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579539.078410:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000524d8183/0xb72beeaffa1b7f12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.078418:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000524d8183/0xb72beeaffa1b7f12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.078436:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000524d8183/0xb72beeaffa1b7f12 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.078456:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000524d8183/0xb72beeaffa1b7f12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.078474:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579539.078476:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579539.078478:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787579539.078756:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579539.078762:0:15485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd9f9142/0xb72beeaffa1b7f19 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.078770:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1787579539.078774:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579539.078778:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd9f9142/0xb72beeaffa1b7f19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.078787:0:15485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd9f9142/0xb72beeaffa1b7f19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.078795:0:15485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd9f9142/0xb72beeaffa1b7f19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.078803:0:15485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd9f9142/0xb72beeaffa1b7f19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.079014:0:14488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787579539.079021:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd9f9142/0xb72beeaffa1b7f19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.079022:0:15485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787579539.079033:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c8a00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579539.079037:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd9f9142/0xb72beeaffa1b7f19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.079045:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd9f9142/0xb72beeaffa1b7f19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.079056:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd9f9142/0xb72beeaffa1b7f19 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.079062:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd9f9142/0xb72beeaffa1b7f19 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.079077:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579539.079080:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579539.079082:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787579539.079697:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579539.079704:0:15485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094935aa0/0xb72beeaffa1b7f20 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.079714:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1787579539.079723:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579539.079728:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094935aa0/0xb72beeaffa1b7f20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.079738:0:15485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094935aa0/0xb72beeaffa1b7f20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.079745:0:15485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094935aa0/0xb72beeaffa1b7f20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.079752:0:15485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094935aa0/0xb72beeaffa1b7f20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.079767:0:15485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787579539.079879:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787579539.079886:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094935aa0/0xb72beeaffa1b7f20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.079893:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c9400 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579539.079897:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094935aa0/0xb72beeaffa1b7f20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.079905:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094935aa0/0xb72beeaffa1b7f20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.079919:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094935aa0/0xb72beeaffa1b7f20 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.079949:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094935aa0/0xb72beeaffa1b7f20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.079964:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579539.079967:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579539.079969:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787579539.080268:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579539.080274:0:15485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0f79e89/0xb72beeaffa1b7f27 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.080282:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1787579539.080285:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579539.080289:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0f79e89/0xb72beeaffa1b7f27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.080309:0:15485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0f79e89/0xb72beeaffa1b7f27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.080317:0:15485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0f79e89/0xb72beeaffa1b7f27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.080330:0:15485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0f79e89/0xb72beeaffa1b7f27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.080355:0:15485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787579539.080388:0:14488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787579539.080395:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0f79e89/0xb72beeaffa1b7f27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.080403:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c9000 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579539.080407:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0f79e89/0xb72beeaffa1b7f27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.080426:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0f79e89/0xb72beeaffa1b7f27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.080438:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0f79e89/0xb72beeaffa1b7f27 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.080445:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0f79e89/0xb72beeaffa1b7f27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.080460:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579539.080462:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579539.080464:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787579539.081124:0:5888:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1787579539.081203:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579539.081210:0:15485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd6c8522/0xb72beeaffa1b7f2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.081219:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1787579539.081223:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579539.081227:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd6c8522/0xb72beeaffa1b7f2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.081236:0:15485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd6c8522/0xb72beeaffa1b7f2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.081244:0:15485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd6c8522/0xb72beeaffa1b7f2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.081251:0:15485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd6c8522/0xb72beeaffa1b7f2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.081262:0:15485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787579539.081891:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579539.081898:0:15485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013fc332c/0xb72beeaffa1b7f35 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.081912:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1787579539.081915:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579539.081919:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013fc332c/0xb72beeaffa1b7f35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.082010:0:15485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013fc332c/0xb72beeaffa1b7f35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.082019:0:15485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013fc332c/0xb72beeaffa1b7f35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.082025:0:15485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013fc332c/0xb72beeaffa1b7f35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.082045:0:15485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787579539.082076:0:14488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787579539.082081:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd6c8522/0xb72beeaffa1b7f2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.082089:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c8400 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579539.082094:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd6c8522/0xb72beeaffa1b7f2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.082102:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd6c8522/0xb72beeaffa1b7f2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.082115:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd6c8522/0xb72beeaffa1b7f2e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.082132:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd6c8522/0xb72beeaffa1b7f2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.082146:0:14488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787579539.082150:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013fc332c/0xb72beeaffa1b7f35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.082156:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c8800 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579539.082159:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013fc332c/0xb72beeaffa1b7f35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.082167:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013fc332c/0xb72beeaffa1b7f35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.082178:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013fc332c/0xb72beeaffa1b7f35 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.082184:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013fc332c/0xb72beeaffa1b7f35 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.082196:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579539.082198:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579539.082200:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579539.082206:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787579539.082451:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579539.082458:0:15485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f583c61/0xb72beeaffa1b7f3c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.082466:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1787579539.082469:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579539.082472:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f583c61/0xb72beeaffa1b7f3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.082675:0:15485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f583c61/0xb72beeaffa1b7f3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.082697:0:15485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f583c61/0xb72beeaffa1b7f3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.082705:0:15485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f583c61/0xb72beeaffa1b7f3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.082723:0:15485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787579539.083195:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579539.083201:0:15485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006482c65e/0xb72beeaffa1b7f43 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.083211:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1787579539.083215:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579539.083220:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006482c65e/0xb72beeaffa1b7f43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.083231:0:15485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006482c65e/0xb72beeaffa1b7f43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.083238:0:15485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006482c65e/0xb72beeaffa1b7f43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.083244:0:15485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006482c65e/0xb72beeaffa1b7f43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.083267:0:15485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787579539.083895:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579539.083900:0:15485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5b5da7d/0xb72beeaffa1b7f4a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.083909:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1787579539.083911:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579539.083915:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5b5da7d/0xb72beeaffa1b7f4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.084012:0:15485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5b5da7d/0xb72beeaffa1b7f4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.084022:0:15485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5b5da7d/0xb72beeaffa1b7f4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.084027:0:15485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5b5da7d/0xb72beeaffa1b7f4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.084036:0:15485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787579539.084645:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579539.084652:0:15485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0d1d891/0xb72beeaffa1b7f51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.084660:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1787579539.084667:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579539.084671:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0d1d891/0xb72beeaffa1b7f51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.084682:0:15485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0d1d891/0xb72beeaffa1b7f51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.084690:0:15485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0d1d891/0xb72beeaffa1b7f51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.084696:0:15485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0d1d891/0xb72beeaffa1b7f51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.084705:0:15485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1787579539.085483:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787579539.085491:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f583c61/0xb72beeaffa1b7f3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.085507:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c9600 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579539.085511:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f583c61/0xb72beeaffa1b7f3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.085520:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f583c61/0xb72beeaffa1b7f3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.085536:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f583c61/0xb72beeaffa1b7f3c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.085544:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f583c61/0xb72beeaffa1b7f3c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.085560:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787579539.085564:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006482c65e/0xb72beeaffa1b7f43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.085570:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c9c00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579539.085573:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006482c65e/0xb72beeaffa1b7f43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.085581:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006482c65e/0xb72beeaffa1b7f43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.085591:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006482c65e/0xb72beeaffa1b7f43 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.085603:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006482c65e/0xb72beeaffa1b7f43 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.085615:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787579539.085619:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5b5da7d/0xb72beeaffa1b7f4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.085625:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c8600 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579539.085628:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5b5da7d/0xb72beeaffa1b7f4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.085635:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5b5da7d/0xb72beeaffa1b7f4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.085645:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5b5da7d/0xb72beeaffa1b7f4a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.085652:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5b5da7d/0xb72beeaffa1b7f4a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.085662:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787579539.085666:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0d1d891/0xb72beeaffa1b7f51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787579539.085681:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579539.085687:0:15485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5278296/0xb72beeaffa1b7f58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.085695:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1787579539.085698:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579539.085703:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5278296/0xb72beeaffa1b7f58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.085712:0:15485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5278296/0xb72beeaffa1b7f58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.085720:0:15485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5278296/0xb72beeaffa1b7f58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.085735:0:15485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5278296/0xb72beeaffa1b7f58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.085743:0:15485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787579539.085778:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce80031400 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579539.085786:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0d1d891/0xb72beeaffa1b7f51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.085794:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0d1d891/0xb72beeaffa1b7f51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.085805:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0d1d891/0xb72beeaffa1b7f51 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.085812:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0d1d891/0xb72beeaffa1b7f51 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.085824:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787579539.085827:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5278296/0xb72beeaffa1b7f58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.085833:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce80031c00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579539.085836:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5278296/0xb72beeaffa1b7f58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.085843:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5278296/0xb72beeaffa1b7f58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.085853:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5278296/0xb72beeaffa1b7f58 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.085860:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5278296/0xb72beeaffa1b7f58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.085878:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579539.085880:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579539.085882:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579539.085889:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787579539.086277:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579539.086283:0:15485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e47d41f3/0xb72beeaffa1b7f5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.086292:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1787579539.086306:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579539.086311:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e47d41f3/0xb72beeaffa1b7f5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.086320:0:15485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e47d41f3/0xb72beeaffa1b7f5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.086328:0:15485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e47d41f3/0xb72beeaffa1b7f5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.086335:0:15485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e47d41f3/0xb72beeaffa1b7f5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.086355:0:15485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787579539.086870:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579539.086876:0:15485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b00b06a/0xb72beeaffa1b7f66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.086889:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1787579539.086893:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579539.086898:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b00b06a/0xb72beeaffa1b7f66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.086907:0:15485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b00b06a/0xb72beeaffa1b7f66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.086915:0:15485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b00b06a/0xb72beeaffa1b7f66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.086923:0:15485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b00b06a/0xb72beeaffa1b7f66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.087078:0:15485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787579539.087877:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579539.087884:0:15485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000835af2e1/0xb72beeaffa1b7f6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.087893:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1787579539.087896:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579539.087900:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000835af2e1/0xb72beeaffa1b7f6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.087910:0:15485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000835af2e1/0xb72beeaffa1b7f6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.087976:0:14488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787579539.087983:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e47d41f3/0xb72beeaffa1b7f5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.087991:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce80031a00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579539.087995:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e47d41f3/0xb72beeaffa1b7f5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.088004:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e47d41f3/0xb72beeaffa1b7f5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.088006:0:15485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000835af2e1/0xb72beeaffa1b7f6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.088014:0:15485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000835af2e1/0xb72beeaffa1b7f6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.088019:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e47d41f3/0xb72beeaffa1b7f5f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.088023:0:15485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787579539.088025:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e47d41f3/0xb72beeaffa1b7f5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.088040:0:14488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787579539.088045:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b00b06a/0xb72beeaffa1b7f66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.088051:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce80030800 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579539.088059:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b00b06a/0xb72beeaffa1b7f66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.088067:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b00b06a/0xb72beeaffa1b7f66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.088078:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b00b06a/0xb72beeaffa1b7f66 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.088085:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b00b06a/0xb72beeaffa1b7f66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.088097:0:14488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787579539.088100:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000835af2e1/0xb72beeaffa1b7f6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.088106:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce80030c00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579539.088109:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000835af2e1/0xb72beeaffa1b7f6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.088116:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000835af2e1/0xb72beeaffa1b7f6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.088126:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000835af2e1/0xb72beeaffa1b7f6d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.088133:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000835af2e1/0xb72beeaffa1b7f6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.088151:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579539.088153:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579539.088155:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579539.088162:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787579539.088841:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579539.088847:0:15485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014c42319/0xb72beeaffa1b7f74 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.088857:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1787579539.088859:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579539.088873:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014c42319/0xb72beeaffa1b7f74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.088884:0:15485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014c42319/0xb72beeaffa1b7f74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.088892:0:15485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014c42319/0xb72beeaffa1b7f74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.088901:0:15485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014c42319/0xb72beeaffa1b7f74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.089004:0:15485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787579539.089145:0:14488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787579539.089150:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014c42319/0xb72beeaffa1b7f74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.089158:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce80031800 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579539.089161:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014c42319/0xb72beeaffa1b7f74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.089169:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014c42319/0xb72beeaffa1b7f74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.089181:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014c42319/0xb72beeaffa1b7f74 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.089188:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014c42319/0xb72beeaffa1b7f74 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.089204:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579539.089206:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579539.089208:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787579539.089618:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579539.089625:0:15485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c91bd341/0xb72beeaffa1b7f7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.089633:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1787579539.089636:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579539.089640:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c91bd341/0xb72beeaffa1b7f7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.089649:0:15485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c91bd341/0xb72beeaffa1b7f7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.089657:0:15485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c91bd341/0xb72beeaffa1b7f7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.089664:0:15485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c91bd341/0xb72beeaffa1b7f7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.089684:0:15485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787579539.089860:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787579539.089866:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c91bd341/0xb72beeaffa1b7f7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.089879:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148b200 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579539.089883:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c91bd341/0xb72beeaffa1b7f7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.089890:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c91bd341/0xb72beeaffa1b7f7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.089900:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c91bd341/0xb72beeaffa1b7f7b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.089906:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c91bd341/0xb72beeaffa1b7f7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.089919:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579539.089921:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579539.089922:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787579539.090140:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579539.090145:0:15485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037afc952/0xb72beeaffa1b7f82 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.090154:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1787579539.090161:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579539.090166:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037afc952/0xb72beeaffa1b7f82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.090174:0:15485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037afc952/0xb72beeaffa1b7f82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.090181:0:15485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037afc952/0xb72beeaffa1b7f82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.090187:0:15485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037afc952/0xb72beeaffa1b7f82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.090208:0:15485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787579539.090811:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579539.090818:0:15485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c717114/0xb72beeaffa1b7f89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.090827:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1787579539.090830:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579539.090834:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c717114/0xb72beeaffa1b7f89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.090843:0:15485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c717114/0xb72beeaffa1b7f89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.090852:0:15485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c717114/0xb72beeaffa1b7f89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.090864:0:15485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c717114/0xb72beeaffa1b7f89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.090876:0:15485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787579539.091244:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579539.091250:0:15485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6effe6b/0xb72beeaffa1b7f90 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.091258:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1787579539.091261:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579539.091265:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6effe6b/0xb72beeaffa1b7f90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.091273:0:15485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6effe6b/0xb72beeaffa1b7f90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.091281:0:15485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6effe6b/0xb72beeaffa1b7f90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.091288:0:15485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6effe6b/0xb72beeaffa1b7f90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.091308:0:15485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787579539.092026:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579539.092032:0:15485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca0f52fe/0xb72beeaffa1b7f97 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.092045:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1787579539.092048:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579539.092052:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca0f52fe/0xb72beeaffa1b7f97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.092061:0:15485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca0f52fe/0xb72beeaffa1b7f97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.092068:0:15485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca0f52fe/0xb72beeaffa1b7f97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.092074:0:15485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca0f52fe/0xb72beeaffa1b7f97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.092081:0:15485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1787579539.092583:0:14488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787579539.092590:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037afc952/0xb72beeaffa1b7f82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.092599:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148a400 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579539.092603:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037afc952/0xb72beeaffa1b7f82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.092612:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037afc952/0xb72beeaffa1b7f82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.092633:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037afc952/0xb72beeaffa1b7f82 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.092640:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037afc952/0xb72beeaffa1b7f82 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.092656:0:14488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00002000:00010000:1.0:1787579539.092658:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787579539.092660:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c717114/0xb72beeaffa1b7f89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.092663:0:15485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ced1f81/0xb72beeaffa1b7f9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.092667:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148b600 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579539.092670:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c717114/0xb72beeaffa1b7f89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.092671:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1787579539.092674:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579539.092678:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ced1f81/0xb72beeaffa1b7f9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.092685:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c717114/0xb72beeaffa1b7f89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.092688:0:15485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ced1f81/0xb72beeaffa1b7f9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.092695:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c717114/0xb72beeaffa1b7f89 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.092702:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c717114/0xb72beeaffa1b7f89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.092706:0:15485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ced1f81/0xb72beeaffa1b7f9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.092713:0:15485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ced1f81/0xb72beeaffa1b7f9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.092714:0:14488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787579539.092717:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6effe6b/0xb72beeaffa1b7f90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.092721:0:15485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787579539.092728:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148ba00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579539.092731:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6effe6b/0xb72beeaffa1b7f90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.092738:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6effe6b/0xb72beeaffa1b7f90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.092748:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6effe6b/0xb72beeaffa1b7f90 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.092755:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6effe6b/0xb72beeaffa1b7f90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.092767:0:14488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787579539.092770:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca0f52fe/0xb72beeaffa1b7f97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.092776:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148ac00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579539.092780:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca0f52fe/0xb72beeaffa1b7f97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.092787:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca0f52fe/0xb72beeaffa1b7f97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.092796:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca0f52fe/0xb72beeaffa1b7f97 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.092808:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca0f52fe/0xb72beeaffa1b7f97 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.092820:0:14488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787579539.092824:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ced1f81/0xb72beeaffa1b7f9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.092831:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148bc00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579539.092834:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ced1f81/0xb72beeaffa1b7f9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.092841:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ced1f81/0xb72beeaffa1b7f9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.092852:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ced1f81/0xb72beeaffa1b7f9e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.092860:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ced1f81/0xb72beeaffa1b7f9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579539.092872:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579539.092873:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579539.092875:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579539.092882:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787579539.093155:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579539.093161:0:15485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f974b61a/0xb72beeaffa1b7fa5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.093169:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=475s v=(0 0) 00010000:00010000:1.0:1787579539.093172:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579539.093177:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f974b61a/0xb72beeaffa1b7fa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.093186:0:15485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f974b61a/0xb72beeaffa1b7fa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.093194:0:15485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f974b61a/0xb72beeaffa1b7fa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.093201:0:15485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f974b61a/0xb72beeaffa1b7fa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579539.093227:0:15485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1787579539.093787:0:15485:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:1.0:1787579539.093873:0:15485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14523:x1874412616903424:12345-0@lo:5:osp-pre-0-0.0 Request processed in 152853us (159800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579539.093881:0:15485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787579539.094027:0:14523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab69880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14523:1874412616903424:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787579539.094042:0:14523:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1787579539.094083:0:14523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4689f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14523:1874412616903552:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787579539.094114:0:14523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579539.094153:0:14523:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce919d8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787579539.094154:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616903552 00000100:00100000:0.0:1787579539.094161:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616903552 00000100:00100000:0.0:1787579539.094201:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787579539.094210:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb468b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14523:x1874412616903552:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787579539.094242:0:15187:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:3.0:1787579539.097622:0:14488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787579539.097637:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f974b61a/0xb72beeaffa1b7fa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579539.097667:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148a200 already unused, calling callback (ffffffffc1654230) 00010000:00010000:3.0:1787579539.097672:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f974b61a/0xb72beeaffa1b7fa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579539.097682:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f974b61a/0xb72beeaffa1b7fa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579539.097705:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f974b61a/0xb72beeaffa1b7fa5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579539.097712:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f974b61a/0xb72beeaffa1b7fa5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579539.097736:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579539.097739:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579539.097741:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579539.105065:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb468b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14523:x1874412616903552:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10850us (10944us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787579539.105078:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787579539.105358:0:14523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4689f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14523:1874412616903552:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787579539.105373:0:14523:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1787579539.302857:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579540.321371:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787579540.571019:0:15553:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg653-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787579541.345263:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579542.380106:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579543.392096:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787579543.694166:0:6735:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1787579543.694221:0:6735:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:3.0:1787579544.032534:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787579544.032550:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787579544.032554:0:479:0:(import.c:65:import_set_state_nolock()) ffffa0ce9185c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787579544.032561:0:479:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 475 00000100:00080000:3.0:1787579544.032566:0:479:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787579544.032573:0:479:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0ce9185c800 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:3.0:1787579544.032595:0:479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0cebab68380 x1874412616903936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787579544.032666:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616904192:0@lo:400:kworker.0 00000100:00100000:3.0:1787579544.032731:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579544.032785:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787579544.032792:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6514e2d9-be54-4793-9feb-dcbd6b926656:3319:1874412616903680:0@lo:400:kworker.0 00000100:00100000:3.0:1787579544.032819:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579544.032850:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616903936:0@lo:8:kworker.0 00000100:00100000:3.0:1787579544.032876:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579544.032916:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616903680 00000100:00100000:3.0:1787579544.032922:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616903680 00000100:00100000:3.0:1787579544.032979:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787579544.032987:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce88251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+16:3319:x1874412616903680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579544.033033:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce88251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+16:3319:x1874412616903680:12345-0@lo:400:kworker.0 Request processed in 47us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579544.033053:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787579544.033095:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6514e2d9-be54-4793-9feb-dcbd6b926656:3319:1874412616903680:0@lo:400:kworker.0 00000100:00100000:3.0:1787579544.033133:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616903936 00000100:00100000:3.0:1787579544.033136:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616903936 00000100:00100000:3.0:1787579544.033156:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787579544.033161:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3318:x1874412616903936:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787579544.033661:0:15185:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787579544.034219:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616903808:0@lo:400:kworker.0 00000100:00100000:0.0:1787579544.034282:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579544.034324:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787579544.034343:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616904064:0@lo:400:kworker.0 00000100:00100000:0.0:1787579544.034369:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579544.034404:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616904192 00000100:00100000:0.0:1787579544.034409:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616904192 00000100:00100000:0.0:1787579544.034450:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616904064 00000100:00100000:0.0:1787579544.034453:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616904064 00000100:00100000:0.0:1787579544.034468:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787579544.034474:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616904192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579544.034523:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616904192:12345-0@lo:400:kworker.0 Request processed in 48us (1791us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579544.034529:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787579544.034556:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787579544.034563:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616904064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579544.034595:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616904064:12345-0@lo:400:kworker.0 Request processed in 33us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579544.034601:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787579544.034624:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787579544.034890:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0cebab6b480 x1874412616904192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579544.034903:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616904192:0@lo:400:kworker.0 00010000:00080000:0.0:1787579544.034957:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0cebab69c00 x1874412616904064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579544.034966:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616904064:0@lo:400:kworker.0 00000100:00100000:0.0:1787579544.035003:0:15485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616903808 00000100:00100000:0.0:1787579544.035007:0:15485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616903808 00000100:00100000:0.0:1787579544.035037:0:15485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787579544.035067:0:15485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616903808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579544.035105:0:15485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616903808:12345-0@lo:400:kworker.0 Request processed in 40us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579544.035111:0:15485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787579544.035128:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787579544.035142:0:3321:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787579544.035153:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616903808:0@lo:400:kworker.0 00000100:00100000:2.0:1787579544.047207:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616904320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787579544.047288:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579544.047639:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616904320 00000100:00100000:1.0:1787579544.047647:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616904320 00000100:00100000:1.0:1787579544.047704:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787579544.047713:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616904320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787579544.047745:0:15188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787579544.047796:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616904320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579544.047804:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787579544.047849:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616904320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787579544.077816:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3318:x1874412616903936:12345-0@lo:8:kworker.0 Request processed in 44646us (44932us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787579544.077830:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787579544.078224:0:3318:0:(import.c:65:import_set_state_nolock()) ffffa0ce9185c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787579544.078253:0:3318:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787579544.078258:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616903936:0@lo:8:kworker.0 00010000:00010000:0.0:1787579544.416392:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787579545.129617:0:14534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787579545.445346:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579546.494061:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579547.491922:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579548.512009:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579549.152699:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616904448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787579549.152760:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579549.152868:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616904448 00000100:00100000:3.0:1787579549.152882:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616904448 00000100:00080000:1.0:1787579549.154656:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787579549.154783:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787579549.154798:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb468a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616904448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787579549.154830:0:15188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787579549.154896:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb468a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616904448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (2135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579549.154904:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787579549.154988:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616904448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787579549.155383:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:3.0:1787579549.155399:0:12671:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787579549.155403:0:12671:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787579549.155407:0:12671:0:(import.c:65:import_set_state_nolock()) ffffa0ce9185c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787579549.155413:0:12671:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 480 00000100:00080000:3.0:1787579549.155417:0:12671:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787579549.155423:0:12671:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0ce9185c800 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:3.0:1787579549.155444:0:12671:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0cebab68a80 x1874412616904704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787579549.155506:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616904832:0@lo:400:kworker.0 00000100:00100000:2.0:1787579549.155546:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616904704:0@lo:8:kworker.0 00000100:00100000:3.0:1787579549.155547:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579549.155575:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787579549.155581:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616904960:0@lo:400:kworker.0 00000100:00100000:3.0:1787579549.155601:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579549.155632:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616904832 00000100:00100000:3.0:1787579549.155637:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616904832 00000100:00100000:2.0:1787579549.155654:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579549.155669:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616904960 00000100:00100000:3.0:1787579549.155673:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616904960 00000100:00100000:3.0:1787579549.155702:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787579549.155711:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616904832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579549.155756:0:15485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616904704 00000100:00100000:2.0:1787579549.155761:0:15485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616904704 00000100:00100000:3.0:1787579549.155763:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616904832:12345-0@lo:400:kworker.0 Request processed in 53us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579549.155771:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787579549.155788:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787579549.155792:0:15485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787579549.155799:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616904960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579549.155801:0:15485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3318:x1874412616904704:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787579549.155819:0:15485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787579549.155834:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616904960:12345-0@lo:400:kworker.0 Request processed in 37us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579549.155842:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1787579549.155874:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787579549.155891:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0cebab6aa00 x1874412616904960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579549.155902:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616904960:0@lo:400:kworker.0 00010000:00080000:3.0:1787579549.155912:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0cebab69500 x1874412616904832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579549.155922:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616904832:0@lo:400:kworker.0 00000100:00100000:1.0:1787579549.156432:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cebab6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6514e2d9-be54-4793-9feb-dcbd6b926656:3321:1874412616904576:0@lo:400:kworker.0 00000100:00100000:1.0:1787579549.156464:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579549.156571:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616904576 00000100:00100000:3.0:1787579549.156575:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616904576 00000100:00100000:3.0:1787579549.156634:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787579549.156640:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce88250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+16:3321:x1874412616904576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579549.156673:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce88250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+16:3321:x1874412616904576:12345-0@lo:400:kworker.0 Request processed in 33us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579549.156678:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787579549.156725:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6514e2d9-be54-4793-9feb-dcbd6b926656:3321:1874412616904576:0@lo:400:kworker.0 00000100:00100000:2.0:1787579549.173581:0:15485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3318:x1874412616904704:12345-0@lo:8:kworker.0 Request processed in 17775us (17923us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787579549.173593:0:15485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787579549.175707:0:3318:0:(import.c:65:import_set_state_nolock()) ffffa0ce9185c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787579549.175716:0:3318:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787579549.175721:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cebab68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616904704:0@lo:8:kworker.0 00010000:00010000:2.0:1787579549.539382:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787579550.011616:0:15905:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787579550.011622:0:15905:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787579550.011769:0:15905:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa0cebf3ef800 00000020:01000004:2.0:1787579550.011786:0:15905:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787579550.011801:0:15905:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787579550.011816:0:15905:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffffa0ce8674cd28) 00000020:00000080:2.0:1787579550.011838:0:15905:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787579550.132180:0:15905:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787579550.132497:0:15905:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787579550.150365:0:15905:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787579550.152511:0:15905:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787579550.155217:0:15905:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787579550.155654:0:15905:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 403: rc = 0 00100000:10000000:2.0:1787579550.157529:0:15905:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 403: rc = 0 00100000:10000000:2.0:1787579550.157671:0:15905:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 403: rc = 0 00100000:10000000:2.0:1787579550.161467:0:15905:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 641: rc = 0 00100000:10000000:2.0:1787579550.162153:0:15905:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 641: rc = 0 00100000:10000000:2.0:1787579550.162435:0:15905:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 641: rc = 0 00100000:10000000:2.0:1787579550.166607:0:15905:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 641: rc = 0 00100000:10000000:2.0:1787579550.170591:0:15905:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:2.0:1787579550.178206:0:15905:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 641: rc = 0 00000020:00000080:2.0:1787579550.180312:0:15905:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787579550.180330:0:15905:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787579550.180346:0:15905:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb72beeaffa1b7fb3 00000020:01000004:2.0:1787579550.180357:0:15905:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787579550.180383:0:15905:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.153@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787579550.180387:0:15905:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787579550.180393:0:15905:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787579550.180424:0:15905:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787579550.180429:0:15905:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.153@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787579550.240832:0:15905:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.153@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787579550.240891:0:15905:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.153@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787579550.240896:0:15905:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787579550.240903:0:15905:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787579550.240904:0:15905:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787579550.240905:0:15905:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787579550.240906:0:15905:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787579550.240907:0:15905:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787579550.240909:0:15905:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787579550.240911:0:15905:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787579550.240912:0:15905:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787579550.240919:0:15905:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787579550.240921:0:15905:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787579550.240922:0:15905:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787579550.240923:0:15905:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787579550.240959:0:15905:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787579550.240960:0:15905:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787579550.240961:0:15905:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787579550.240962:0:15905:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787579550.240963:0:15905:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787579550.240964:0:15905:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787579550.241609:0:15905:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787579550.241635:0:15905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616905088:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787579550.241738:0:15905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579550.241852:0:15905:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fbd900 going to sleep for 11 seconds 00000100:00100000:1.0:1787579550.246275:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616905088 00000100:00100000:1.0:1787579550.246295:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616905088 00000100:00100000:1.0:1787579550.246381:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787579550.246393:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce88251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+16:15905:x1874412616905088:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787579550.246465:0:14492:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787579550.246469:0:14492:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1787579550.246473:0:14492:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787579550.302517:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce88251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+16:15905:x1874412616905088:12345-0@lo:253:mount.lustre.0 Request processed in 56111us (60763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579550.302535:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787579550.302892:0:15905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616905088:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787579550.302912:0:15905:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787579550.302917:0:15905:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787579550.302919:0:15905:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787579550.302920:0:15905:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787579550.302921:0:15905:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787579550.302922:0:15905:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787579550.302952:0:15905:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787579550.302954:0:15905:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787579550.302956:0:15905:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787579550.302974:0:15905:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787579550.302999:0:15905:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0cebf3ef800 from lustre-OST0001 10000000:01000000:0.0:1787579550.303046:0:15905:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787579550.303049:0:15905:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787579550.303057:0:15905:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa0ceb485cd28 local copy 00010000:00010000:0.0:1787579550.303070:0:15905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce90a8b600/0xb72beeaffa1b7d59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7d60 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579550.303384:0:15905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616905216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787579550.303435:0:15905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579550.316951:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616905216 00000100:00100000:3.0:1787579550.316972:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616905216 00000100:00100000:0.0:1787579550.319115:0:15905:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fbdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787579550.320472:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787579550.320829:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce88253c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+16:15905:x1874412616905216:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787579550.330081:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce88253c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+16:15905:x1874412616905216:12345-0@lo:501:mount.lustre.0 Request processed in 9255us (26629us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787579550.330100:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787579550.331020:0:15905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616905216:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787579550.331056:0:15905:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787579550.331388:0:15905:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787579550.331400:0:15905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce90a8b600/0xb72beeaffa1b7d59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7d60 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579550.331411:0:15905:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce90a8b600/0xb72beeaffa1b7d59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7d60 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579550.331442:0:15905:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0cebf3ef800 10000000:01000000:0.0:1787579550.331448:0:15905:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787579550.331454:0:15905:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787579550.331457:0:15905:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787579550.331462:0:15905:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787579550.331465:0:15905:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787579550.331633:0:15905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9c00/0xb72beeaffa1b7fba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579550.331653:0:15905:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9c00/0xb72beeaffa1b7fba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579550.331672:0:15905:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9c00/0xb72beeaffa1b7fba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579550.331820:0:15905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616905344:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787579550.332094:0:15905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579550.332147:0:15905:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fbdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787579550.332455:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616905344 00000100:00100000:2.0:1787579550.332465:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616905344 00000100:00100000:2.0:1787579550.332546:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787579550.332558:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce88251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+16:15905:x1874412616905344:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787579550.332575:0:14492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579550.332593:0:14492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceba318000/0xb72beeaffa1b7fc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b7fba expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579550.332622:0:14492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceba318000/0xb72beeaffa1b7fc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b7fba expref: 17 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579550.332912:0:14492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceba318000/0xb72beeaffa1b7fc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b7fba expref: 17 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579550.332922:0:14492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba318000, rc 0) 00000100:00100000:2.0:1787579550.333122:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce88251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+17:15905:x1874412616905344:12345-0@lo:101:mount.lustre.0 Request processed in 566us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579550.333131:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787579550.333432:0:15905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616905344:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787579550.333450:0:15905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9c00/0xb72beeaffa1b7fba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7fc1 expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579550.333461:0:15905:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9c00/0xb72beeaffa1b7fba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b7fc1 expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787579550.335608:0:15905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787579550.336644:0:15905:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787579550.337006:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787579550.337051:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787579550.337085:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787579550.337144:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787579550.337184:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787579550.337212:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787579550.337291:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787579550.337300:0:15905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787579550.337402:0:15905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616905472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787579550.341058:0:15905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579550.341128:0:15905:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fbd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787579550.342136:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616905472 00000100:00100000:3.0:1787579550.342152:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616905472 00000100:00100000:3.0:1787579550.342224:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787579550.342245:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce88250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+17:15905:x1874412616905472:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787579550.343420:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce88250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+17:15905:x1874412616905472:12345-0@lo:501:mount.lustre.0 Request processed in 1181us (2369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579550.343432:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787579550.343715:0:15905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616905472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787579550.343794:0:15905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616905600:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787579550.343848:0:15905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579550.343887:0:15905:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fbd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787579550.344272:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616905600 00000100:00100000:3.0:1787579550.344287:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616905600 00000100:00100000:3.0:1787579550.344336:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787579550.344345:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce88250c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+17:15905:x1874412616905600:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787579550.344982:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce88250c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+17:15905:x1874412616905600:12345-0@lo:503:mount.lustre.0 Request processed in 635us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579550.344992:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787579550.345202:0:15905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616905600:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787579550.347957:0:15905:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787579550.348440:0:15905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616905728:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787579550.348624:0:15905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579550.350407:0:15905:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fbd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787579550.351620:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616905728 00000100:00100000:3.0:1787579550.351633:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616905728 00000100:00100000:3.0:1787579550.351829:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787579550.351848:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce88253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+17:15905:x1874412616905728:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787579550.354673:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce88253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+17:15905:x1874412616905728:12345-0@lo:502:mount.lustre.0 Request processed in 2822us (6037us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579550.354690:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787579550.357824:0:15905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616905728:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787579550.358600:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787579550.358674:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787579550.358719:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787579550.358769:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787579550.358804:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787579550.358839:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787579550.358886:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787579550.358923:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787579550.361102:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1787579550.361202:0:15905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616905856:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787579550.361340:0:15905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579550.361400:0:15905:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fbd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787579550.363157:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616905856 00000100:00100000:3.0:1787579550.363171:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616905856 00000100:00100000:3.0:1787579550.363259:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787579550.363279:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce88252050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+17:15905:x1874412616905856:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787579550.363720:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce88252050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+17:15905:x1874412616905856:12345-0@lo:502:mount.lustre.0 Request processed in 383us (2316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579550.363729:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787579550.364430:0:15905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616905856:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787579550.364558:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1787579550.364571:0:15905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1787579550.368251:0:15906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787579550.368276:0:15906:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787579550.368301:0:15906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579550.368303:0:15906:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787579550.368311:0:15906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787579550.368331:0:15906:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffffa0ceb4858000) 00000020:00000080:0.0:1787579550.368361:0:15906:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787579550.368367:0:15906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787579550.368456:0:15906:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0cebf3ef800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787579550.368466:0:15906:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787579550.368474:0:15906:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb72beeaffa1b7fcf 00010000:00010000:2.0:1787579550.380080:0:15906:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1787579550.381048:0:15906:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1787579550.383177:0:15906:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787579550.392437:0:15906:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787579550.392452:0:15906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787579550.392460:0:15906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579550.392462:0:15906:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787579550.392465:0:15906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787579550.392469:0:15906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579550.392471:0:15906:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787579550.392474:0:15906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787579550.392490:0:15906:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787579550.392492:0:15906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787579550.392495:0:15906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579550.392496:0:15906:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787579550.392498:0:15906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787579550.392501:0:15906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579550.392502:0:15906:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787579550.392505:0:15906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787579550.392586:0:15906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787579550.392589:0:15906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579550.392590:0:15906:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787579550.392593:0:15906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1787579550.402949:0:15905:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1787579550.403221:0:15905:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787579550.405368:0:15905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9c00/0xb72beeaffa1b7fba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7fc1 expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579550.405392:0:15905:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c9c00/0xb72beeaffa1b7fba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7fc1 expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579550.405425:0:15905:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0cebf3ef800 from 1 10000000:01000000:1.0:1787579550.405428:0:15905:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787579550.405489:0:15905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b200/0xb72beeaffa1b7fd6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579550.405497:0:15905:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b200/0xb72beeaffa1b7fd6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579550.405509:0:15905:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b200/0xb72beeaffa1b7fd6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579550.405542:0:15905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4689f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616905984:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787579550.405626:0:15905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579550.405852:0:15905:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce8613b240 going to sleep for 11 seconds 00000100:00100000:0.0:1787579550.411467:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616905984 00000100:00100000:0.0:1787579550.411499:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616905984 00000100:00100000:0.0:1787579550.411569:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787579550.411581:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce9701a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+17:15905:x1874412616905984:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787579550.411600:0:14494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579550.411624:0:14494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceba3c9e00/0xb72beeaffa1b7fdd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b7fd6 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579550.411667:0:14494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceba3c9e00/0xb72beeaffa1b7fdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b7fd6 expref: 18 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579550.411679:0:14494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceba3c9e00/0xb72beeaffa1b7fdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b7fd6 expref: 18 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579550.411689:0:14494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c9e00, rc 0) 00000100:00100000:0.0:1787579550.411792:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce9701a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+18:15905:x1874412616905984:12345-0@lo:101:mount.lustre.0 Request processed in 213us (6166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579550.411799:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787579550.415260:0:15905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4689f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616905984:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787579550.415307:0:15905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b200/0xb72beeaffa1b7fd6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7fdd expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579550.415322:0:15905:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b200/0xb72beeaffa1b7fd6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b7fdd expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787579550.416444:0:15905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787579550.424812:0:15905:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787579550.425663:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787579550.427341:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787579550.427468:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787579550.428433:0:15905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787579550.434244:0:15905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4689f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616906112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787579550.434366:0:15905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579550.434419:0:15905:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce8613b240 going to sleep for 11 seconds 00000100:00100000:3.0:1787579550.435848:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616906112 00000100:00100000:3.0:1787579550.435863:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616906112 00000100:00100000:3.0:1787579550.436659:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787579550.436678:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce9701a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+18:15905:x1874412616906112:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787579550.438817:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce9701a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+18:15905:x1874412616906112:12345-0@lo:501:mount.lustre.0 Request processed in 2134us (4440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579550.438833:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787579550.439039:0:15905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4689f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616906112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787579550.439108:0:15905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4689f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616906240:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787579550.439182:0:15905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579550.446917:0:15905:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce8613b240 going to sleep for 11 seconds 00000100:00100000:0.0:1787579550.453145:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616906240 00000100:00100000:0.0:1787579550.453165:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616906240 00000100:00100000:0.0:1787579550.453255:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787579550.453816:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf38f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+18:15905:x1874412616906240:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787579550.460604:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf38f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+18:15905:x1874412616906240:12345-0@lo:503:mount.lustre.0 Request processed in 7203us (21287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579550.460622:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787579550.460874:0:15905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4689f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616906240:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787579550.461783:0:15905:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787579550.461902:0:15905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4689f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616906368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787579550.462052:0:15905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579550.462107:0:15905:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cea1485cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787579550.462227:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616906368 00000100:00100000:3.0:1787579550.462250:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616906368 00000100:00100000:3.0:1787579550.462378:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787579550.462389:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf38f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+18:15905:x1874412616906368:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787579550.465379:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf38f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+18:15905:x1874412616906368:12345-0@lo:502:mount.lustre.0 Request processed in 2978us (3315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579550.465396:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787579550.465673:0:15905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4689f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616906368:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787579550.466561:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787579550.466628:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787579550.467755:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787579550.467813:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787579550.467841:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787579550.467885:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787579550.467917:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787579550.468399:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787579550.468459:0:15905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4689f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616906496:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787579550.469899:0:15905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579550.469991:0:15905:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cea1485cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787579550.470196:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616906496 00000100:00100000:0.0:1787579550.470206:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616906496 00000100:00100000:0.0:1787579550.470395:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787579550.470409:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf38fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+18:15905:x1874412616906496:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787579550.482241:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf38fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+18:15905:x1874412616906496:12345-0@lo:502:mount.lustre.0 Request processed in 11808us (12317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579550.482262:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787579550.482614:0:15905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4689f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616906496:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787579550.483400:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787579550.483422:0:15905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787579550.493589:0:15910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787579550.493608:0:15910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579550.493611:0:15910:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787579550.493619:0:15910:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0cebf3ef800 00000020:00000080:1.0:1787579550.493621:0:15910:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787579550.493630:0:15910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787579550.493632:0:15910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579550.493633:0:15910:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787579550.493635:0:15910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787579550.493637:0:15910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579550.493650:0:15910:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787579550.493654:0:15910:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0cebf3ef800 00000020:00000080:1.0:1787579550.493656:0:15910:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787579550.494366:0:15910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787579550.494373:0:15910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579550.494375:0:15910:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787579550.494379:0:15910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787579550.494381:0:15910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579550.494382:0:15910:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787579550.494386:0:15910:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0cebf3ef800 00000020:00000080:1.0:1787579550.494387:0:15910:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787579550.494444:0:15910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787579550.494447:0:15910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579550.494448:0:15910:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787579550.494451:0:15910:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787579550.509753:0:15905:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787579550.509811:0:15905:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787579550.509832:0:15905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b200/0xb72beeaffa1b7fd6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7fdd expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579550.509848:0:15905:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b200/0xb72beeaffa1b7fd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7fdd expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579550.509986:0:15905:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787579550.509990:0:15905:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0cebf3ef800 10000000:01000000:2.0:1787579550.509993:0:15905:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0cebf3ef800 10000000:01000000:2.0:1787579550.509998:0:15905:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787579550.510013:0:15905:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0cebf3ef800 from 1 10000000:01000000:2.0:1787579550.510017:0:15905:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787579550.510082:0:15905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba319c00/0xb72beeaffa1b7fe4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579550.510091:0:15905:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ceba319c00/0xb72beeaffa1b7fe4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579550.510103:0:15905:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ceba319c00/0xb72beeaffa1b7fe4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579550.510132:0:15905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616906624:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787579550.510220:0:15905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579550.510321:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616906624 00000100:00100000:2.0:1787579550.510330:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616906624 00000100:00100000:2.0:1787579550.510379:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787579550.510389:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf38e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+18:15905:x1874412616906624:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787579550.510403:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579550.510417:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceba318200/0xb72beeaffa1b7feb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b7fe4 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579550.510443:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceba318200/0xb72beeaffa1b7feb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b7fe4 expref: 19 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579550.510454:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceba318200/0xb72beeaffa1b7feb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b7fe4 expref: 19 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579550.510464:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba318200, rc 0) 00000100:00100000:2.0:1787579550.510791:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf38e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+19:15905:x1874412616906624:12345-0@lo:101:mount.lustre.0 Request processed in 402us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579550.510799:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787579550.510871:0:15905:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceba43db40 going to sleep for 11 seconds 00000100:00100000:2.0:1787579550.510898:0:15905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616906624:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787579550.510915:0:15905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ceba319c00/0xb72beeaffa1b7fe4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7feb expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579550.510946:0:15905:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ceba319c00/0xb72beeaffa1b7fe4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b7feb expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787579550.517455:0:15905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1787579550.526470:0:15905:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787579550.531946:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787579550.538010:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787579550.538050:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787579550.538133:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787579550.538172:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787579550.538223:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787579550.538347:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787579550.538382:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787579550.538435:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787579550.538470:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787579550.538501:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787579550.538548:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787579550.538587:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787579550.538620:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787579550.538667:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787579550.538703:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787579550.538736:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787579550.538785:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787579550.538818:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787579550.538849:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787579550.538894:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787579550.538958:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787579550.539020:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787579550.539066:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787579550.539103:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787579550.540422:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787579550.540540:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787579550.540578:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787579550.540611:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787579550.544498:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1787579550.544600:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1787579550.544637:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1787579550.544683:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1787579550.545153:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1787579550.545193:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1787579550.545340:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1787579550.545377:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1787579550.545471:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1787579550.546365:0:15905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1787579550.547131:0:15905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616906752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787579550.547212:0:15905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579550.548846:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616906752 00000100:00100000:1.0:1787579550.548860:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616906752 00000100:00100000:1.0:1787579550.548941:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787579550.548963:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce893fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+19:15905:x1874412616906752:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787579550.550780:0:15905:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceba43db40 going to sleep for 11 seconds 00000100:00100000:2.0:1787579550.555442:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce893fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+19:15905:x1874412616906752:12345-0@lo:501:mount.lustre.0 Request processed in 6478us (8216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579550.555460:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787579550.555568:0:15905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616906752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787579550.555631:0:15905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616906880:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787579550.555710:0:15905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579550.555749:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616906880 00000100:00100000:2.0:1787579550.555756:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616906880 00000100:00100000:2.0:1787579550.555802:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787579550.555820:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce893fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+19:15905:x1874412616906880:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787579550.556143:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce893fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+19:15905:x1874412616906880:12345-0@lo:503:mount.lustre.0 Request processed in 324us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579550.556151:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787579550.556203:0:15905:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceba43db40 going to sleep for 11 seconds 00000100:00100000:2.0:1787579550.556217:0:15905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616906880:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787579550.556901:0:15905:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787579550.557010:0:15905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616907008:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787579550.557059:0:15905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579550.557106:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616907008 00000100:00100000:2.0:1787579550.557112:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616907008 00000100:00100000:2.0:1787579550.557142:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787579550.557150:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+19:15905:x1874412616907008:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787579550.557377:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+19:15905:x1874412616907008:12345-0@lo:502:mount.lustre.0 Request processed in 227us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579550.557385:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787579550.557426:0:15905:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce867e8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787579550.557443:0:15905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616907008:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787579550.557702:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787579550.557754:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787579550.557787:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787579550.557827:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787579550.557864:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787579550.557910:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787579550.557977:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787579550.558012:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787579550.558059:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787579550.558107:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787579550.558140:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787579550.567032:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787579550.567111:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787579550.567178:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787579550.567241:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787579550.567591:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787579550.567626:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787579550.567669:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787579550.567765:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787579550.567799:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787579550.567839:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787579550.567873:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787579550.567900:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787579550.568625:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787579550.569379:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1787579550.569434:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1787579550.570140:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1787579550.570195:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1787579550.571205:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1787579550.571434:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1787579550.572149:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1787579550.572209:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1787579550.572258:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1787579550.572896:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1787579550.573656:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1787579550.574155:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1787579550.574200:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1787579550.574253:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1787579550.574523:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1787579550.574563:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1787579550.574631:0:15905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616907136:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787579550.575889:0:15905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579550.577219:0:15905:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce92d470c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787579550.585870:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616907136 00000100:00100000:3.0:1787579550.585892:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616907136 00010000:00010000:1.0:1787579550.591620:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579550.598897:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787579550.598915:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+19:15905:x1874412616907136:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787579550.603207:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+19:15905:x1874412616907136:12345-0@lo:502:mount.lustre.0 Request processed in 4283us (27305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579550.603249:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787579550.607492:0:15905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616907136:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787579550.607673:0:15905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1787579550.607698:0:15905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787579550.613639:0:15915:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787579550.613672:0:15915:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffffa0ceb44a8000) 00000020:00000080:1.0:1787579550.613821:0:15915:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1787579550.613910:0:15915:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0cebf3ef800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787579550.613915:0:15915:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0cebf3ef800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787579550.613918:0:15915:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0cebf3ef800 3 00010000:00080000:1.0:1787579550.614360:0:15915:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0ce92c93000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.153@tcp at head 00010000:00010000:1.0:1787579550.618420:0:15915:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1787579550.618665:0:15915:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787579550.627239:0:15915:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787579550.627276:0:15915:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xb72beeaffa1b7ff9 00000100:00080000:1.0:1787579550.627291:0:15915:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787579550.627298:0:15915:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa0ce92c93000 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:1.0:1787579550.627342:0:15915:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ceb4689180 x1874412616907264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787579550.627370:0:15915:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787579550.627478:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3318:1874412616907264:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787579550.627509:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787579550.627515:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787579550.627518:0:479:0:(import.c:65:import_set_state_nolock()) ffffa0ce9185c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787579550.627524:0:479:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 485 00000100:00080000:2.0:1787579550.627528:0:479:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787579550.627532:0:479:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0ce9185c800 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:2.0:1787579550.627548:0:479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ceb480f800 x1874412616907520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787579550.627573:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579550.627750:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616907392:0@lo:400:kworker.0 00000100:00100000:1.0:1787579550.627786:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579550.627813:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787579550.627818:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616907648:0@lo:400:kworker.0 00000100:00100000:1.0:1787579550.627838:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579550.627869:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616907392 00000100:00100000:0.0:1787579550.627871:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616907520:0@lo:8:kworker.0 00000100:00100000:1.0:1787579550.627876:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616907392 00000100:00100000:0.0:1787579550.627923:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579550.627948:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787579550.627960:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616907392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579550.627986:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616907264 00000100:00100000:0.0:1787579550.627992:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616907264 00000100:00100000:0.0:1787579550.628020:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616907648 00000100:00100000:0.0:1787579550.628023:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616907648 00000100:00100000:1.0:1787579550.628032:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616907392:12345-0@lo:400:kworker.0 Request processed in 74us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579550.628042:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787579550.628047:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787579550.628056:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616907648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579550.628063:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616907520 00000100:00100000:1.0:1787579550.628074:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616907520 00000100:00100000:0.0:1787579550.628098:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1874412616907648:12345-0@lo:400:kworker.0 Request processed in 42us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579550.628101:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787579550.628112:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3318:x1874412616907520:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787579550.628112:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787579550.628131:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787579550.628137:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3318:x1874412616907264:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787579550.628156:0:14500:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 486 last 0 00000100:00100000:1.0:1787579550.628168:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3318:x1874412616907520:12345-0@lo:8:kworker.0 Request processed in 55us (249us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787579550.628177:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000020:00000080:0.0:1787579550.628218:0:14500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xb72beeaffa1b8000 00010000:00080000:1.0:1787579550.628219:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceb480ce00 x1874412616907648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00100000:0.0:1787579550.628246:0:14500:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1787579550.628255:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3321:1874412616907648:0@lo:400:kworker.0 00000100:00100000:1.0:1787579550.628273:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616907392:0@lo:400:kworker.0 00000100:00080000:0.0:1787579550.628294:0:14500:0:(import.c:65:import_set_state_nolock()) ffffa0ce84edc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787579550.628308:0:3318:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787579550.628315:0:3318:0:(import.c:65:import_set_state_nolock()) ffffa0ce9185c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787579550.628320:0:3318:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787579550.628324:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616907520:0@lo:8:kworker.0 00000100:00100000:0.0:1787579550.628336:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874412616907264:12345-0@lo:38:llog_process_th.0 Request processed in 197us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579550.628347:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787579550.628348:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceb4689180 x1874412616907264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787579560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579550.628357:0:3318:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787579550.628363:0:3318:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1787579550.628371:0:3318:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787579550.628376:0:3318:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787579550.628378:0:3318:0:(import.c:65:import_set_state_nolock()) ffffa0ce92c93000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787579550.628383:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3318:1874412616907264:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787579550.629484:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787579550.629509:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1874412616907776:0@lo:400:kworker.0 00000100:00100000:0.0:1787579550.629562:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579550.631892:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616907776 00000100:00100000:1.0:1787579550.631908:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616907776 00000100:00100000:1.0:1787579550.632110:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787579550.632134:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874412616907776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579550.632251:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874412616907776:12345-0@lo:400:kworker.0 Request processed in 119us (2687us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579550.632258:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1787579550.632334:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceb480ca80 x1874412616907776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579550.632351:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1874412616907776:0@lo:400:kworker.0 00000040:00080000:0.0:1787579550.649177:0:15915:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1787579550.661399:0:15905:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787579550.661458:0:15905:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787579550.661494:0:15905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba319c00/0xb72beeaffa1b7fe4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7feb expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579550.661509:0:15905:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ceba319c00/0xb72beeaffa1b7fe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b7feb expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787579550.661626:0:15905:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787579550.661629:0:15905:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787579550.661630:0:15905:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787579550.661631:0:15905:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787579550.661633:0:15905:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787579550.661635:0:15905:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787579550.661636:0:15905:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787579550.661639:0:15905:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787579550.661646:0:15905:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787579550.661651:0:15905:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787579550.661653:0:15905:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787579550.661654:0:15905:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787579550.661655:0:15905:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787579550.661656:0:15905:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787579550.661657:0:15905:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787579550.661659:0:15905:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787579550.661660:0:15905:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787579550.661660:0:15905:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787579550.661661:0:15905:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787579550.661704:0:15905:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787579550.661731:0:15905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616907904:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787579550.661824:0:15905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579550.661898:0:15905:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce867e8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787579550.667205:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616907904 00000100:00100000:1.0:1787579550.667225:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616907904 00000100:00100000:1.0:1787579550.667354:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787579550.667367:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+19:15905:x1874412616907904:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787579550.667435:0:14492:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787579550.667455:0:14492:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787579550.790574:0:14492:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787579550.790598:0:14492:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787579550.791960:0:14516:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787579550.791969:0:14516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787579550.791998:0:14516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0ceba318800/0xb72beeaffa1b8007 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579550.792029:0:14516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ceb47c8c00/0xb72beeaffa1b7eda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b7ed3 expref: 19 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579550.792039:0:14516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0ceba318800/0xb72beeaffa1b8007 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579550.792089:0:14516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ceb47c8c00/0xb72beeaffa1b7eda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b7ed3 expref: 19 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579550.792105:0:14516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0ceb47c8c00/0xb72beeaffa1b7eda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b7ed3 expref: 19 pid: 14494 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579550.792122:0:14516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14516:1874412616908032:0@lo:104: 00000100:00100000:2.0:1787579550.792452:0:14516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579550.792622:0:14516:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce92d476c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787579550.792709:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616908032 00000100:00100000:0.0:1787579550.792720:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616908032 00000100:00100000:0.0:1787579550.792775:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787579550.792785:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6514e2d9-be54-4793-9feb-dcbd6b926656+3:14516:x1874412616908032:12345-0@lo:104: 00010000:00010000:0.0:1787579550.792800:0:14483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8000/0xb72beeaffa1b7ed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b7eda expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579550.792858:0:14483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787579550.792865:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6514e2d9-be54-4793-9feb-dcbd6b926656+3:14516:x1874412616908032:12345-0@lo:104: Request processed in 81us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579550.792872:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787579550.792897:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787579550.792904:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8000/0xb72beeaffa1b7ed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b7eda expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579550.792912:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8000 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:0.0:1787579550.792924:0:14489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8000/0xb72beeaffa1b7ed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b7eda expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579550.792967:0:14489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8000/0xb72beeaffa1b7ed3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b7eda expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787579550.792975:0:14489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8000/0xb72beeaffa1b7ed3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b7eda expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579550.792982:0:14489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787579550.793023:0:14489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8000/0xb72beeaffa1b7ed3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b7eda expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579550.793030:0:14489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787579550.793052:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8000/0xb72beeaffa1b7ed3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b7eda expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579550.793059:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8000/0xb72beeaffa1b7ed3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b7eda expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579550.793076:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579550.793078:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579550.793080:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579550.793087:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787579550.793100:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6514e2d9-be54-4793-9feb-dcbd6b926656:3319:1874412616908160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787579550.793132:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579550.793177:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616908160 00000100:00100000:0.0:1787579550.793180:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616908160 00010000:00010000:0.0:1787579550.793198:0:14486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ceb47c8c00/0xb72beeaffa1b7eda lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b7ed3 expref: 20 pid: 14494 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579550.793241:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787579550.793249:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6514e2d9-be54-4793-9feb-dcbd6b926656+20:3319:x1874412616908160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787579550.793261:0:14486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579550.793276:0:14486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ceb47c8c00/0xb72beeaffa1b7eda lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b7ed3 expref: 20 pid: 14494 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579550.793286:0:14486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ceb47c8c00/0xb72beeaffa1b7eda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b7ed3 expref: 20 pid: 14494 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579550.793303:0:14486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0ceba318800/0xb72beeaffa1b8007 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579550.793311:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceba318800/0xb72beeaffa1b8007 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787579550.793325:0:14486:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003366996s 00010000:00010000:0.0:1787579550.793330:0:14486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0ceba318800/0xb72beeaffa1b8007 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579550.793337:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0ceba318800/0xb72beeaffa1b8007 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579550.793344:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0ceba318800/0xb72beeaffa1b8007 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579550.793350:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0ceba318800/0xb72beeaffa1b8007 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579550.793355:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318800 already unused, calling callback (ffffffffc1654230) 00010000:00010000:0.0:1787579550.793364:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0ceba318800/0xb72beeaffa1b8007 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579550.793372:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0ceba318800/0xb72beeaffa1b8007 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579550.793381:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0ceba318800/0xb72beeaffa1b8007 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579550.793391:0:14486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579550.793418:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6514e2d9-be54-4793-9feb-dcbd6b926656+20:3319:x1874412616908160:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579550.793424:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787579550.793458:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6514e2d9-be54-4793-9feb-dcbd6b926656:3319:1874412616908160:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787579550.796872:0:14516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ceb47c8c00/0xb72beeaffa1b7eda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b7ed3 expref: 19 pid: 14494 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579550.796897:0:14516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14516:1874412616908032:0@lo:104: 00010000:00010000:0.0:1787579550.796943:0:14516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0ceba318800/0xb72beeaffa1b8007 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579550.796962:0:14516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0ceba318800/0xb72beeaffa1b8007 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579550.796969:0:14516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0ceba318800/0xb72beeaffa1b8007 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579550.796975:0:14516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ceba318800/0xb72beeaffa1b8007 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579550.813322:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+18:15905:x1874412616907904:12345-0@lo:253:mount.lustre.0 Request processed in 145947us (151487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579550.813339:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787579550.813859:0:15905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6514e2d9-be54-4793-9feb-dcbd6b926656:15905:1874412616907904:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787579550.813882:0:15905:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787579550.813885:0:15905:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787579550.813888:0:15905:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787579550.813889:0:15905:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787579550.813890:0:15905:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787579550.813892:0:15905:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787579550.813893:0:15905:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787579550.813895:0:15905:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787579550.813897:0:15905:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787579550.813898:0:15905:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787579550.813919:0:15905:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787579550.828681:0:15905:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787579550.828846:0:15905:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787579550.829425:0:15905:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787579550.829677:0:15905:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787579550.830892:0:15905:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787579550.831912:0:15905:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787579550.837683:0:15905:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787579550.965568:0:15905:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787579550.965580:0:15905:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787579550.965626:0:15905:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787579550.965700:0:15905:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.153@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787579550.965719:0:15905:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787579550.965754:0:15905:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1787579551.648141:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579552.672238:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787579552.692895:0:14497:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787579552.692904:0:14497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0ce91c07000 from 8 10000000:01000000:1.0:1787579552.692909:0:14497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787579552.692976:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148ba00/0xb72beeaffa1b800e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579552.692988:0:14497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ce8148ba00/0xb72beeaffa1b800e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579552.692998:0:14497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ce8148ba00/0xb72beeaffa1b800e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579552.693038:0:14497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4689180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616908288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787579552.693115:0:14497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579552.693173:0:14497:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb1c51840 going to sleep for 11 seconds 00000100:00100000:2.0:1787579552.693258:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616908288 00000100:00100000:2.0:1787579552.693266:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616908288 00000100:00100000:2.0:1787579552.693316:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787579552.693327:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+18:14497:x1874412616908288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787579552.693351:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579552.693364:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceba319a00/0xb72beeaffa1b8015 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b800e expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579552.693387:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceba319a00/0xb72beeaffa1b8015 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b800e expref: 19 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579552.693398:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceba319a00/0xb72beeaffa1b8015 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b800e expref: 19 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579552.693420:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319a00, rc 0) 00000100:00100000:2.0:1787579552.693487:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+19:14497:x1874412616908288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579552.693494:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787579552.693914:0:14497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4689180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616908288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787579552.693961:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ce8148ba00/0xb72beeaffa1b800e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b8015 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579552.693971:0:14497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ce8148ba00/0xb72beeaffa1b800e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b8015 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579552.694021:0:14497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4689180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616908416:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787579552.694057:0:14497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579552.694080:0:14497:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceb1c51840 going to sleep for 11 seconds 00000100:00100000:2.0:1787579552.694181:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616908416 00000100:00100000:2.0:1787579552.694186:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616908416 00000100:00100000:2.0:1787579552.694231:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787579552.694240:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+19:14497:x1874412616908416:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787579552.694254:0:14492:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787579552.694269:0:14492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787579552.694272:0:14492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787579552.694370:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+19:14497:x1874412616908416:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 131us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579552.694378:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787579552.694807:0:14497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4689180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616908416:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787579552.694866:0:14497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787579552.694873:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ce8148ba00/0xb72beeaffa1b800e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b8015 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579552.694882:0:14497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ce8148ba00/0xb72beeaffa1b800e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b8015 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579553.696202:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579554.287702:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616908544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787579554.287768:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579554.287864:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616908544 00000100:00100000:2.0:1787579554.287871:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616908544 00000100:00100000:2.0:1787579554.287915:0:15189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787579554.287939:0:15189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616908544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787579554.287982:0:15189:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579554.288025:0:15189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616908544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579554.288032:0:15189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787579554.288051:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787579554.288093:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616908544:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787579554.720353:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787579555.361534:0:14534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787579555.744886:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787579555.814566:0:12671:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787579555.814573:0:12671:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787579555.814584:0:12671:0:(import.c:65:import_set_state_nolock()) ffffa0ce9185c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787579555.814607:0:12671:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0ce9185c800 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:1.0:1787579555.814639:0:12671:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ceb468b100 x1874412616908928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787579555.814690:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616909184:0@lo:400:kworker.0 00000100:00100000:1.0:1787579555.814768:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579555.814827:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787579555.814834:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6514e2d9-be54-4793-9feb-dcbd6b926656:3321:1874412616908672:0@lo:400:kworker.0 00000100:00100000:1.0:1787579555.814862:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579555.814885:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1874412616909312:0@lo:400:kworker.0 00000100:00100000:1.0:1787579555.814905:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579555.814945:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616908800:0@lo:400:kworker.0 00000100:00100000:1.0:1787579555.814970:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579555.814991:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787579555.814996:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb4688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616909056:0@lo:400:kworker.0 00000100:00100000:1.0:1787579555.815015:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579555.815043:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616908928:0@lo:8:kworker.0 00000100:00100000:1.0:1787579555.815150:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579555.815188:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616909184 00000100:00100000:1.0:1787579555.815194:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616909184 00000100:00100000:1.0:1787579555.815248:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616909312 00000100:00100000:1.0:1787579555.815259:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616909312 00000100:00100000:1.0:1787579555.815274:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616909056 00000100:00100000:1.0:1787579555.815276:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616909056 00000100:00100000:1.0:1787579555.815290:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787579555.815297:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616909184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579555.815355:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616909184:12345-0@lo:400:kworker.0 Request processed in 58us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579555.815369:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787579555.815385:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787579555.815390:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb468ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874412616909312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579555.815418:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb468ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874412616909312:12345-0@lo:400:kworker.0 Request processed in 27us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579555.815424:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787579555.815434:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787579555.815440:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616909056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579555.815469:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616909056:12345-0@lo:400:kworker.0 Request processed in 30us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579555.815475:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787579555.815491:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616908672 00000100:00100000:1.0:1787579555.815495:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616908672 00000100:00100000:1.0:1787579555.815518:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787579555.815524:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+19:3321:x1874412616908672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579555.816009:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+19:3321:x1874412616908672:12345-0@lo:400:kworker.0 Request processed in 26us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579555.816019:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787579555.816054:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616908800 00000100:00100000:1.0:1787579555.816058:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616908800 00000100:00100000:1.0:1787579555.816096:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616908928 00000100:00100000:1.0:1787579555.816100:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616908928 00000100:00100000:1.0:1787579555.816116:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787579555.816122:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616908800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579555.816156:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616908800:12345-0@lo:400:kworker.0 Request processed in 34us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579555.816183:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787579555.816197:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787579555.816201:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4689f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3318:x1874412616908928:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787579555.816235:0:15185:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:1.0:1787579555.816266:0:15185:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb72beeaffa1b801c 00002000:00100000:1.0:1787579555.816280:0:15185:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffffa0ce90459000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787579555.816284:0:15185:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787579555.816287:0:15185:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787579555.816847:0:15185:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787579555.816870:0:15185:0:(import.c:65:import_set_state_nolock()) ffffa0ce9045a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787579555.816952:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4689f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3318:x1874412616908928:12345-0@lo:8:kworker.0 Request processed in 749us (1801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579555.816960:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1787579555.816988:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787579555.817025:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceb468b100 x1874412616908928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787579580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787579555.817040:0:3318:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787579555.817046:0:3318:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787579555.817050:0:3318:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787579555.817052:0:3318:0:(import.c:65:import_set_state_nolock()) ffffa0ce9185c800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00010000:00080000:0.0:1787579555.822256:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceb4688a80 x1874412616909056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579555.822276:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616909056:0@lo:400:kworker.0 00000100:00100000:0.0:1787579555.822291:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616908800:0@lo:400:kworker.0 00000100:00100000:0.0:1787579555.822338:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb4689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6514e2d9-be54-4793-9feb-dcbd6b926656:3321:1874412616908672:0@lo:400:kworker.0 00010000:00080000:0.0:1787579555.822350:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceb468b800 x1874412616909312/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579555.822360:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1874412616909312:0@lo:400:kworker.0 00010000:00080000:0.0:1787579555.822372:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceb468a300 x1874412616909184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579555.822382:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616909184:0@lo:400:kworker.0 00000004:00080000:1.0:1787579555.822573:0:3318:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787579555.822582:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3318:1874412616908928:0@lo:8:kworker.0 00000004:00080000:1.0:1787579555.822639:0:14525:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1787579555.822661:0:14525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14525:1874412616909568:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787579555.822715:0:14525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579555.822764:0:14525:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce919d8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787579555.822776:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787579555.822785:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb468b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616909440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787579555.822810:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579555.822850:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616909440 00000100:00100000:1.0:1787579555.822855:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616909440 00000100:00100000:1.0:1787579555.822903:0:15189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787579555.822911:0:15189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4689180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1874412616909440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787579555.822961:0:15189:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787579555.823536:0:15189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4689180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1874412616909440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 623us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579555.823544:0:15189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787579555.823568:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787579555.823580:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616909568 00000100:00100000:1.0:1787579555.823584:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616909568 00000100:00100000:1.0:1787579555.823610:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787579555.823617:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb468b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14525:x1874412616909568:12345-0@lo:5:osp-pre-1-0.0 00010000:00080000:0.0:1787579555.823913:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ceb468b100 x1874412616909440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579555.823943:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616909440:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1787579555.827192:0:14524:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787579555.827569:0:14524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 492018641230ns, next at 0ns, rc = 0 00002000:00080000:1.0:1787579555.841457:0:15185:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787579555.841467:0:15185:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1787579555.841472:0:15185:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:1.0:1787579555.865510:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579555.865522:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f974b61a/0xb72beeaffa1b8023 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.865537:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1787579555.865542:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579555.865548:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f974b61a/0xb72beeaffa1b8023 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.865577:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f974b61a/0xb72beeaffa1b8023 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.865587:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f974b61a/0xb72beeaffa1b8023 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.865594:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f974b61a/0xb72beeaffa1b8023 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.865621:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787579555.865640:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787579555.865646:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f974b61a/0xb72beeaffa1b8023 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.865653:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148a200 already unused, calling callback (ffffffffc1654230) 00010000:00010000:1.0:1787579555.865658:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f974b61a/0xb72beeaffa1b8023 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.865667:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f974b61a/0xb72beeaffa1b8023 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.865682:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f974b61a/0xb72beeaffa1b8023 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.865689:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f974b61a/0xb72beeaffa1b8023 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.865714:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579555.865716:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579555.865717:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787579555.866520:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579555.866528:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ced1f81/0xb72beeaffa1b802a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.866538:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1787579555.866541:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579555.866547:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ced1f81/0xb72beeaffa1b802a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.866558:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ced1f81/0xb72beeaffa1b802a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.866566:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ced1f81/0xb72beeaffa1b802a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.866574:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ced1f81/0xb72beeaffa1b802a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.866589:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787579555.870196:0:14488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787579555.870218:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ced1f81/0xb72beeaffa1b802a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.870232:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148bc00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:3.0:1787579555.870237:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ced1f81/0xb72beeaffa1b802a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.870247:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ced1f81/0xb72beeaffa1b802a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.870273:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ced1f81/0xb72beeaffa1b802a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.870281:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ced1f81/0xb72beeaffa1b802a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.870302:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579555.870305:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579555.870306:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787579555.875139:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579555.875154:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca0f52fe/0xb72beeaffa1b8031 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.875184:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1787579555.875189:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579555.875196:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca0f52fe/0xb72beeaffa1b8031 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.875223:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca0f52fe/0xb72beeaffa1b8031 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.875234:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca0f52fe/0xb72beeaffa1b8031 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.875243:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca0f52fe/0xb72beeaffa1b8031 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.875261:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787579555.875274:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787579555.875279:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca0f52fe/0xb72beeaffa1b8031 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.875287:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148ac00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:1.0:1787579555.875292:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca0f52fe/0xb72beeaffa1b8031 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.875302:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca0f52fe/0xb72beeaffa1b8031 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.875332:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca0f52fe/0xb72beeaffa1b8031 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.875339:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca0f52fe/0xb72beeaffa1b8031 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.875356:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579555.875358:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579555.875360:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787579555.878357:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579555.878368:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c717114/0xb72beeaffa1b8038 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.878383:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1787579555.878387:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579555.878394:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c717114/0xb72beeaffa1b8038 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.878408:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c717114/0xb72beeaffa1b8038 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.878416:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c717114/0xb72beeaffa1b8038 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.878424:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c717114/0xb72beeaffa1b8038 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.878454:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787579555.878854:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579555.878860:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037afc952/0xb72beeaffa1b803f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.878869:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1787579555.878872:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579555.878876:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037afc952/0xb72beeaffa1b803f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.878885:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037afc952/0xb72beeaffa1b803f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.878892:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037afc952/0xb72beeaffa1b803f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.878898:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037afc952/0xb72beeaffa1b803f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.878913:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787579555.878942:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787579555.878948:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c717114/0xb72beeaffa1b8038 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.878956:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148b600 already unused, calling callback (ffffffffc1654230) 00010000:00010000:1.0:1787579555.878967:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c717114/0xb72beeaffa1b8038 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.878975:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c717114/0xb72beeaffa1b8038 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.878991:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c717114/0xb72beeaffa1b8038 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.878998:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c717114/0xb72beeaffa1b8038 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.879014:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787579555.879017:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037afc952/0xb72beeaffa1b803f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.879024:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148a400 already unused, calling callback (ffffffffc1654230) 00010000:00010000:1.0:1787579555.879027:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037afc952/0xb72beeaffa1b803f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.879035:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037afc952/0xb72beeaffa1b803f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.879045:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037afc952/0xb72beeaffa1b803f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.879052:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037afc952/0xb72beeaffa1b803f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.879073:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579555.879075:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579555.879077:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787579555.879501:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579555.879512:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060e9cd3a/0xb72beeaffa1b8046 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.879521:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1787579555.879525:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579555.879529:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060e9cd3a/0xb72beeaffa1b8046 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.879542:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060e9cd3a/0xb72beeaffa1b8046 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.879551:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060e9cd3a/0xb72beeaffa1b8046 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.879558:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060e9cd3a/0xb72beeaffa1b8046 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.879572:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787579555.879581:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787579555.879584:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060e9cd3a/0xb72beeaffa1b8046 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.879606:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148b400 already unused, calling callback (ffffffffc1654230) 00010000:00010000:1.0:1787579555.879610:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060e9cd3a/0xb72beeaffa1b8046 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.879617:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060e9cd3a/0xb72beeaffa1b8046 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.879629:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060e9cd3a/0xb72beeaffa1b8046 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.879636:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060e9cd3a/0xb72beeaffa1b8046 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.879650:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579555.879652:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579555.879654:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787579555.880430:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579555.880437:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050346ae4/0xb72beeaffa1b804d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.880447:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1787579555.880450:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579555.880455:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050346ae4/0xb72beeaffa1b804d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.880464:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050346ae4/0xb72beeaffa1b804d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.880479:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050346ae4/0xb72beeaffa1b804d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.880487:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050346ae4/0xb72beeaffa1b804d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.880501:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787579555.880510:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787579555.880514:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050346ae4/0xb72beeaffa1b804d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.880521:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148a000 already unused, calling callback (ffffffffc1654230) 00010000:00010000:1.0:1787579555.880524:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050346ae4/0xb72beeaffa1b804d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.880531:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050346ae4/0xb72beeaffa1b804d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.880541:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050346ae4/0xb72beeaffa1b804d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.880548:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050346ae4/0xb72beeaffa1b804d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.880561:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579555.880568:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579555.880570:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787579555.881068:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579555.881075:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fec35f0/0xb72beeaffa1b8054 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.881083:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1787579555.881087:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579555.881091:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fec35f0/0xb72beeaffa1b8054 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.881102:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fec35f0/0xb72beeaffa1b8054 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.881109:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fec35f0/0xb72beeaffa1b8054 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.881116:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fec35f0/0xb72beeaffa1b8054 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.881137:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787579555.881219:0:14488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787579555.881227:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fec35f0/0xb72beeaffa1b8054 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.881239:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148b000 already unused, calling callback (ffffffffc1654230) 00010000:00010000:3.0:1787579555.881251:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fec35f0/0xb72beeaffa1b8054 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.881260:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fec35f0/0xb72beeaffa1b8054 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.881273:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fec35f0/0xb72beeaffa1b8054 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.881280:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fec35f0/0xb72beeaffa1b8054 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.881297:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579555.881300:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579555.881301:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579555.881338:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787579555.881571:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579555.881577:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fec907d3/0xb72beeaffa1b805b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.881585:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1787579555.881588:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579555.881591:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fec907d3/0xb72beeaffa1b805b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.881607:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fec907d3/0xb72beeaffa1b805b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.881614:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fec907d3/0xb72beeaffa1b805b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.881621:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fec907d3/0xb72beeaffa1b805b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.881875:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787579555.881899:0:14488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787579555.882050:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fec907d3/0xb72beeaffa1b805b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.882061:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148b800 already unused, calling callback (ffffffffc1654230) 00010000:00010000:3.0:1787579555.882066:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fec907d3/0xb72beeaffa1b805b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.882075:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fec907d3/0xb72beeaffa1b805b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.882088:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fec907d3/0xb72beeaffa1b805b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.882102:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fec907d3/0xb72beeaffa1b805b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.882263:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579555.882265:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579555.882267:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787579555.882463:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579555.882471:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002299740b/0xb72beeaffa1b8062 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.882481:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1787579555.882484:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579555.882488:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002299740b/0xb72beeaffa1b8062 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.882498:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002299740b/0xb72beeaffa1b8062 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.882506:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002299740b/0xb72beeaffa1b8062 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.882528:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002299740b/0xb72beeaffa1b8062 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.882582:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787579555.883094:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787579555.883102:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002299740b/0xb72beeaffa1b8062 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.883112:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148a600 already unused, calling callback (ffffffffc1654230) 00010000:00010000:0.0:1787579555.883117:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002299740b/0xb72beeaffa1b8062 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.883127:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002299740b/0xb72beeaffa1b8062 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.883142:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002299740b/0xb72beeaffa1b8062 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.883151:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002299740b/0xb72beeaffa1b8062 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787579555.883168:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787579555.883171:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579555.883174:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579555.883176:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1fece05/0xb72beeaffa1b8069 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.883177:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579555.883189:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1787579555.883192:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579555.883197:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1fece05/0xb72beeaffa1b8069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.883220:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1fece05/0xb72beeaffa1b8069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.883229:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1fece05/0xb72beeaffa1b8069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.883236:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1fece05/0xb72beeaffa1b8069 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.883254:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787579555.883265:0:14488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787579555.883271:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1fece05/0xb72beeaffa1b8069 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.883291:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd8351e400 already unused, calling callback (ffffffffc1654230) 00010000:00010000:0.0:1787579555.883295:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1fece05/0xb72beeaffa1b8069 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.883302:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1fece05/0xb72beeaffa1b8069 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.883313:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1fece05/0xb72beeaffa1b8069 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.883319:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1fece05/0xb72beeaffa1b8069 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.883335:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579555.883338:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579555.883340:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787579555.883822:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579555.883829:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8b4ae3c/0xb72beeaffa1b8070 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.883845:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1787579555.883848:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579555.883852:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8b4ae3c/0xb72beeaffa1b8070 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.883861:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8b4ae3c/0xb72beeaffa1b8070 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.883869:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8b4ae3c/0xb72beeaffa1b8070 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.883877:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8b4ae3c/0xb72beeaffa1b8070 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.883894:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787579555.883904:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787579555.883908:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8b4ae3c/0xb72beeaffa1b8070 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.883916:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd8351f600 already unused, calling callback (ffffffffc1654230) 00010000:00010000:1.0:1787579555.883920:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8b4ae3c/0xb72beeaffa1b8070 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.883947:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8b4ae3c/0xb72beeaffa1b8070 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.883969:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8b4ae3c/0xb72beeaffa1b8070 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.883977:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8b4ae3c/0xb72beeaffa1b8070 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.883990:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579555.883992:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579555.883994:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787579555.884689:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787579555.884696:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab7b4dfb/0xb72beeaffa1b8077 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.884705:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1787579555.884709:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787579555.884713:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab7b4dfb/0xb72beeaffa1b8077 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.884730:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab7b4dfb/0xb72beeaffa1b8077 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.884739:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab7b4dfb/0xb72beeaffa1b8077 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.884746:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab7b4dfb/0xb72beeaffa1b8077 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.884781:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787579555.885086:0:14488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787579555.885094:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab7b4dfb/0xb72beeaffa1b8077 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.885102:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd8351f000 already unused, calling callback (ffffffffc1654230) 00010000:00010000:3.0:1787579555.885106:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab7b4dfb/0xb72beeaffa1b8077 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.885115:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab7b4dfb/0xb72beeaffa1b8077 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.885131:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab7b4dfb/0xb72beeaffa1b8077 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.885138:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab7b4dfb/0xb72beeaffa1b8077 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.885158:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579555.885161:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579555.885163:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787579555.886819:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787579555.886830:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f5f1ce3/0xb72beeaffa1b807e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.886843:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787579555.886847:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579555.886852:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f5f1ce3/0xb72beeaffa1b807e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.886868:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f5f1ce3/0xb72beeaffa1b807e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.886877:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f5f1ce3/0xb72beeaffa1b807e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.886885:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f5f1ce3/0xb72beeaffa1b807e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.886908:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787579555.887075:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787579555.887083:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f5f1ce3/0xb72beeaffa1b807e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.887094:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8b400 already unused, calling callback (ffffffffc1654230) 00010000:00010000:0.0:1787579555.887099:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f5f1ce3/0xb72beeaffa1b807e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.887109:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f5f1ce3/0xb72beeaffa1b807e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.887131:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f5f1ce3/0xb72beeaffa1b807e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.887139:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f5f1ce3/0xb72beeaffa1b807e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.887156:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579555.887159:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579555.887162:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787579555.887383:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787579555.887389:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057192080/0xb72beeaffa1b8085 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.887398:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787579555.887401:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579555.887405:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057192080/0xb72beeaffa1b8085 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.887427:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057192080/0xb72beeaffa1b8085 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.887435:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057192080/0xb72beeaffa1b8085 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.887442:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057192080/0xb72beeaffa1b8085 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.887467:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787579555.887578:0:14488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787579555.887583:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057192080/0xb72beeaffa1b8085 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.887589:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8a200 already unused, calling callback (ffffffffc1654230) 00010000:00010000:0.0:1787579555.887592:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057192080/0xb72beeaffa1b8085 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.887597:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057192080/0xb72beeaffa1b8085 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.887605:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057192080/0xb72beeaffa1b8085 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.887610:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057192080/0xb72beeaffa1b8085 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.887638:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579555.887641:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579555.887644:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787579555.887888:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787579555.887895:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082723b3d/0xb72beeaffa1b808c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.887903:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787579555.887907:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579555.887911:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082723b3d/0xb72beeaffa1b808c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.887921:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082723b3d/0xb72beeaffa1b808c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.887951:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082723b3d/0xb72beeaffa1b808c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.887970:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082723b3d/0xb72beeaffa1b808c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.887984:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787579555.887988:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787579555.887994:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082723b3d/0xb72beeaffa1b808c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.888002:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8ac00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:0.0:1787579555.888006:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082723b3d/0xb72beeaffa1b808c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.888014:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082723b3d/0xb72beeaffa1b808c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.888026:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082723b3d/0xb72beeaffa1b808c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.888033:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082723b3d/0xb72beeaffa1b808c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.888053:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579555.888055:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579555.888058:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787579555.891999:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787579555.892010:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccfa390b/0xb72beeaffa1b8093 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.892024:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787579555.892028:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579555.892033:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccfa390b/0xb72beeaffa1b8093 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.892046:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccfa390b/0xb72beeaffa1b8093 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.892065:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccfa390b/0xb72beeaffa1b8093 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.892073:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ccfa390b/0xb72beeaffa1b8093 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.892097:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787579555.893072:0:14488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787579555.893080:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ccfa390b/0xb72beeaffa1b8093 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.893090:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8a400 already unused, calling callback (ffffffffc1654230) 00010000:00010000:1.0:1787579555.893095:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccfa390b/0xb72beeaffa1b8093 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.893105:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccfa390b/0xb72beeaffa1b8093 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.893122:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ccfa390b/0xb72beeaffa1b8093 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.893130:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccfa390b/0xb72beeaffa1b8093 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.893150:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579555.893152:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579555.893154:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787579555.893347:0:5888:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1787579555.894510:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787579555.894519:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050e095b3/0xb72beeaffa1b809a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.894539:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787579555.894543:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579555.894548:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050e095b3/0xb72beeaffa1b809a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.894570:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050e095b3/0xb72beeaffa1b809a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.894580:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050e095b3/0xb72beeaffa1b809a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.894587:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050e095b3/0xb72beeaffa1b809a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.894646:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787579555.895175:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787579555.895181:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031bf09b3/0xb72beeaffa1b80a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.895190:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787579555.895193:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579555.895197:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031bf09b3/0xb72beeaffa1b80a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.895219:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031bf09b3/0xb72beeaffa1b80a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.895237:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031bf09b3/0xb72beeaffa1b80a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.895243:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031bf09b3/0xb72beeaffa1b80a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.895428:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787579555.895435:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050e095b3/0xb72beeaffa1b809a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.897240:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8a600 already unused, calling callback (ffffffffc1654230) 00010000:00010000:0.0:1787579555.897245:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050e095b3/0xb72beeaffa1b809a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.897254:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050e095b3/0xb72beeaffa1b809a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.897273:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050e095b3/0xb72beeaffa1b809a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.897280:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050e095b3/0xb72beeaffa1b809a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.897304:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787579555.897309:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031bf09b3/0xb72beeaffa1b80a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.897316:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce90a8b200 already unused, calling callback (ffffffffc1654230) 00010000:00010000:0.0:1787579555.897319:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031bf09b3/0xb72beeaffa1b80a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.897326:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031bf09b3/0xb72beeaffa1b80a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.897335:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031bf09b3/0xb72beeaffa1b80a1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.897350:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579555.897352:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579555.897355:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579555.897489:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787579555.897496:0:15185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031bf09b3/0xb72beeaffa1b80a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787579555.901172:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787579555.901200:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b090974/0xb72beeaffa1b80a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.901225:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787579555.901230:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579555.901237:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b090974/0xb72beeaffa1b80a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.901252:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b090974/0xb72beeaffa1b80a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.901262:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b090974/0xb72beeaffa1b80a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.901282:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b090974/0xb72beeaffa1b80a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.901350:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787579555.902029:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787579555.902035:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7a22602/0xb72beeaffa1b80af lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.902044:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787579555.902048:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579555.902052:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7a22602/0xb72beeaffa1b80af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.902062:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7a22602/0xb72beeaffa1b80af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.902069:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7a22602/0xb72beeaffa1b80af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.902076:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7a22602/0xb72beeaffa1b80af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.905118:0:14488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787579555.905285:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787579555.905294:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7a22602/0xb72beeaffa1b80af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.905309:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd82a00e00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:0.0:1787579555.905313:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7a22602/0xb72beeaffa1b80af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.905325:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7a22602/0xb72beeaffa1b80af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.905345:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7a22602/0xb72beeaffa1b80af lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.905357:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579555.905359:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579555.905361:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579555.907735:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787579555.907748:0:15185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7a22602/0xb72beeaffa1b80af lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.908717:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787579555.908806:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787579555.908813:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db0c38db/0xb72beeaffa1b80b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.908826:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787579555.908831:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579555.908837:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db0c38db/0xb72beeaffa1b80b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.908850:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db0c38db/0xb72beeaffa1b80b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.908860:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db0c38db/0xb72beeaffa1b80b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.908867:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db0c38db/0xb72beeaffa1b80b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.908956:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787579555.909388:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787579555.909394:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c043f764/0xb72beeaffa1b80bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.909403:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787579555.909405:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579555.909415:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c043f764/0xb72beeaffa1b80bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.909424:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c043f764/0xb72beeaffa1b80bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.909433:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c043f764/0xb72beeaffa1b80bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.909440:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c043f764/0xb72beeaffa1b80bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.909516:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b090974/0xb72beeaffa1b80a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.909537:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd82a01200 already unused, calling callback (ffffffffc1654230) 00010000:00010000:1.0:1787579555.909542:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b090974/0xb72beeaffa1b80a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.909551:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b090974/0xb72beeaffa1b80a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.909764:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787579555.910036:0:16123:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787579555.910044:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db0c38db/0xb72beeaffa1b80b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.910064:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd82a00600 already unused, calling callback (ffffffffc1654230) 00010000:00010000:0.0:1787579555.910068:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db0c38db/0xb72beeaffa1b80b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.910075:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db0c38db/0xb72beeaffa1b80b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.910090:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db0c38db/0xb72beeaffa1b80b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.910097:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db0c38db/0xb72beeaffa1b80b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.910116:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579555.910118:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579555.910120:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579555.910217:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b090974/0xb72beeaffa1b80a8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.910226:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b090974/0xb72beeaffa1b80a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.910289:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579555.910291:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579555.910293:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579555.910348:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787579555.911017:0:16124:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579555.911024:0:16123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c043f764/0xb72beeaffa1b80bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.911033:0:16123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd82a00a00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:1.0:1787579555.911036:0:16123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c043f764/0xb72beeaffa1b80bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.911045:0:16123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c043f764/0xb72beeaffa1b80bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.911057:0:16123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c043f764/0xb72beeaffa1b80bd lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.911071:0:16123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c043f764/0xb72beeaffa1b80bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.911090:0:16123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579555.911092:0:16123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787579555.911185:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787579555.911191:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f5aea7b/0xb72beeaffa1b80c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.911201:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787579555.911216:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579555.911221:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f5aea7b/0xb72beeaffa1b80c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.911231:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f5aea7b/0xb72beeaffa1b80c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.911240:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f5aea7b/0xb72beeaffa1b80c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.911259:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f5aea7b/0xb72beeaffa1b80c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.911305:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787579555.911311:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f5aea7b/0xb72beeaffa1b80c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.911318:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd82a00800 already unused, calling callback (ffffffffc1654230) 00010000:00010000:0.0:1787579555.911321:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f5aea7b/0xb72beeaffa1b80c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.911341:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f5aea7b/0xb72beeaffa1b80c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.911352:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f5aea7b/0xb72beeaffa1b80c4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.911360:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579555.911362:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579555.911364:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579555.911471:0:16123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579555.911478:0:16124:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579555.911480:0:16124:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579555.911535:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787579555.911541:0:15185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f5aea7b/0xb72beeaffa1b80c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787579555.912243:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787579555.912249:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074545148/0xb72beeaffa1b80cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.912259:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787579555.912263:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579555.912267:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074545148/0xb72beeaffa1b80cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.912277:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074545148/0xb72beeaffa1b80cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.912285:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074545148/0xb72beeaffa1b80cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.912293:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074545148/0xb72beeaffa1b80cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.912438:0:14488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787579555.912444:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074545148/0xb72beeaffa1b80cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.912452:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd82a01e00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:0.0:1787579555.912455:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074545148/0xb72beeaffa1b80cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.912464:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074545148/0xb72beeaffa1b80cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.912477:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074545148/0xb72beeaffa1b80cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.912485:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579555.912487:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579555.912489:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579555.912551:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787579555.912556:0:15185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074545148/0xb72beeaffa1b80cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787579555.914167:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787579555.914175:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7a22602/0xb72beeaffa1b80d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.914187:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787579555.914191:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579555.914196:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7a22602/0xb72beeaffa1b80d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.914219:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7a22602/0xb72beeaffa1b80d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.914228:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7a22602/0xb72beeaffa1b80d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.914236:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7a22602/0xb72beeaffa1b80d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.914327:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787579555.914334:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7a22602/0xb72beeaffa1b80d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.914341:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd82a00e00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:0.0:1787579555.914346:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7a22602/0xb72beeaffa1b80d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.914354:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7a22602/0xb72beeaffa1b80d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.914368:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7a22602/0xb72beeaffa1b80d2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579555.914377:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579555.914379:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579555.914381:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579555.914448:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787579555.914454:0:15185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7a22602/0xb72beeaffa1b80d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787579555.915497:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787579555.915504:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026e91471/0xb72beeaffa1b80d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.915514:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787579555.915517:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579555.915521:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026e91471/0xb72beeaffa1b80d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.915530:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026e91471/0xb72beeaffa1b80d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.915537:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026e91471/0xb72beeaffa1b80d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579555.915544:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026e91471/0xb72beeaffa1b80d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.915881:0:16123:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787579555.915888:0:16123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026e91471/0xb72beeaffa1b80d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.915897:0:16123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd82a01a00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:1.0:1787579555.915901:0:16123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026e91471/0xb72beeaffa1b80d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.915909:0:16123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026e91471/0xb72beeaffa1b80d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.915954:0:16123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026e91471/0xb72beeaffa1b80d9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579555.915964:0:16123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579555.915966:0:16123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579555.915969:0:16123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579555.916063:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787579555.916068:0:15185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026e91471/0xb72beeaffa1b80d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1787579555.916300:0:15185:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1787579555.916397:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb468b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14525:x1874412616909568:12345-0@lo:5:osp-pre-1-0.0 Request processed in 92777us (93678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579555.916417:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787579555.916508:0:14525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb468a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14525:1874412616909568:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787579555.916523:0:14525:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00010000:00010000:1.0:1787579555.916645:0:16124:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579555.916673:0:14525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14525:1874412616909696:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787579555.916710:0:14525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579555.916757:0:14525:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cebf2e3300 going to sleep for 11 seconds 00000100:00100000:1.0:1787579555.916810:0:15186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616909696 00000100:00100000:1.0:1787579555.916816:0:15186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616909696 00000100:00100000:1.0:1787579555.916865:0:15186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787579555.916875:0:15186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14525:x1874412616909696:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787579555.916910:0:15186:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1787579555.927062:0:15186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14525:x1874412616909696:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10181us (10343us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787579555.927074:0:15186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787579555.927622:0:14525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14525:1874412616909696:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787579555.927635:0:14525:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000001:00100000:2.0:1787579556.462608:0:7670:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787579556.462622:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:0.0:1787579556.771094:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579557.792394:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787579557.832527:0:16265:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg653-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787579558.816970:0:16123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579559.394567:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787579559.394589:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616909824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787579559.394650:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579559.394824:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616909824 00000100:00100000:2.0:1787579559.394832:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616909824 00000100:00100000:2.0:1787579559.394891:0:15189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787579559.394900:0:15189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb468bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616909824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787579559.394997:0:15189:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787579559.395012:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787579559.395062:0:15189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb468bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616909824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 162us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579559.395071:0:15189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787579559.395169:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616909824:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787579559.843509:0:16124:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579560.353744:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579560.353982:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591751424 00000100:00100000:1.0:1787579560.353995:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591751424 00000100:00100000:1.0:1787579560.354053:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 76 00000100:00100000:1.0:1787579560.354063:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1492450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2358:x1874412591751424:12345-192.168.206.53@tcp:250:mount.lustre.0 00010000:00080000:1.0:1787579560.354102:0:14495:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 006d1ed3-2214-4ba1-a0e0-c1e7e674e492@192.168.206.53@tcp t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:1.0:1787579560.354154:0:14495:0:(genops.c:1385:class_connect()) connect: client 006d1ed3-2214-4ba1-a0e0-c1e7e674e492, cookie 0xb72beeaffa1b80e0 00000100:00080000:1.0:1787579560.355485:0:14495:0:(import.c:65:import_set_state_nolock()) ffffa0cebf7f8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787579560.355676:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1492450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+5:2358:x1874412591751424:12345-192.168.206.53@tcp:250:mount.lustre.0 Request processed in 1605us (1939us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579560.355701:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 76 00000100:00100000:3.0:1787579560.378065:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579560.378416:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591751552 00000100:00100000:1.0:1787579560.378430:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591751552 00000100:00100000:1.0:1787579560.378516:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 77 00000100:00100000:1.0:1787579560.378529:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+5:13782:x1874412591751552:12345-192.168.206.53@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787579560.378577:0:14494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579560.378604:0:14494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0cd8351fa00/0xb72beeaffa1b80e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d2dd expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579560.378642:0:14494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0cd8351fa00/0xb72beeaffa1b80e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2dd expref: 6 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579560.378654:0:14494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0cd8351fa00/0xb72beeaffa1b80e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2dd expref: 6 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579560.378664:0:14494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0cd8351fa00, rc 0) 00000100:00100000:1.0:1787579560.378750:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+6:13782:x1874412591751552:12345-192.168.206.53@tcp:101:mount.lustre.0 Request processed in 222us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579560.378757:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 77 00000100:00100000:2.0:1787579560.391355:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579560.393003:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591751680 00000100:00100000:1.0:1787579560.393023:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591751680 00000100:00100000:1.0:1787579560.393123:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 78 00000100:00100000:1.0:1787579560.393136:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1493850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+6:13782:x1874412591751680:12345-192.168.206.53@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787579560.393555:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1493850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+6:13782:x1874412591751680:12345-192.168.206.53@tcp:501:mount.lustre.0 Request processed in 419us (2212us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787579560.393565:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 78 00000100:00100000:0.0:1787579560.398505:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579560.398619:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591751808 00000100:00100000:2.0:1787579560.398632:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591751808 00000100:00100000:2.0:1787579560.398703:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 79 00000100:00100000:2.0:1787579560.398715:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1492850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+6:13782:x1874412591751808:12345-192.168.206.53@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787579560.398735:0:14492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579560.398760:0:14492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceba319600/0xb72beeaffa1b80ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d2e4 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579560.398797:0:14492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceba319600/0xb72beeaffa1b80ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2e4 expref: 7 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579560.398811:0:14492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceba319600/0xb72beeaffa1b80ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d2e4 expref: 7 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579560.398822:0:14492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319600, rc 0) 00000100:00100000:2.0:1787579560.398896:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1492850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+7:13782:x1874412591751808:12345-192.168.206.53@tcp:101:mount.lustre.0 Request processed in 184us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579560.398903:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 79 00000100:00100000:3.0:1787579560.409450:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579560.410313:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591751936 00000100:00100000:0.0:1787579560.410327:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591751936 00000100:00100000:0.0:1787579560.410400:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 80 00000100:00100000:0.0:1787579560.410412:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+7:13782:x1874412591751936:12345-192.168.206.53@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787579560.411282:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+8:13782:x1874412591751936:12345-192.168.206.53@tcp:501:mount.lustre.0 Request processed in 864us (1838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579560.411295:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 80 00000100:00100000:0.0:1787579560.422296:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579560.422405:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591752064 00000100:00100000:1.0:1787579560.422419:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591752064 00000100:00100000:1.0:1787579560.422486:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 81 00000100:00100000:1.0:1787579560.422498:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+8:13782:x1874412591752064:12345-192.168.206.53@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787579560.423021:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+8:13782:x1874412591752064:12345-192.168.206.53@tcp:503:mount.lustre.0 Request processed in 523us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579560.423039:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 81 00000100:00100000:1.0:1787579560.428138:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579560.428252:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591752192 00000100:00100000:0.0:1787579560.428265:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591752192 00000100:00100000:0.0:1787579560.428340:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 82 00000100:00100000:0.0:1787579560.428352:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf63c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+8:13801:x1874412591752192:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787579560.428851:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf63c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+8:13801:x1874412591752192:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 499us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579560.428862:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 82 00000100:00100000:3.0:1787579560.453257:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579560.453453:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591752320 00000100:00100000:2.0:1787579560.453466:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591752320 00000100:00100000:2.0:1787579560.453539:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 83 00000100:00100000:2.0:1787579560.453551:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf63dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+8:13801:x1874412591752320:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787579560.454305:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf63dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+8:13801:x1874412591752320:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 750us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579560.454317:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 83 00000100:00100000:2.0:1787579560.473064:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579560.473535:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591752448 00000100:00100000:1.0:1787579560.473549:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591752448 00000100:00100000:1.0:1787579560.473622:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 84 00000100:00100000:1.0:1787579560.473635:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf63cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+8:13782:x1874412591752448:12345-192.168.206.53@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787579560.473657:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579560.473683:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0cd8351e000/0xb72beeaffa1b80f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d30e expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579560.473733:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0cd8351e000/0xb72beeaffa1b80f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d30e expref: 9 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579560.473744:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0cd8351e000/0xb72beeaffa1b80f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d30e expref: 9 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579560.473755:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0cd8351e000, rc 0) 00000100:00100000:1.0:1787579560.473841:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf63cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+9:13782:x1874412591752448:12345-192.168.206.53@tcp:101:mount.lustre.0 Request processed in 209us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579560.473849:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 84 00000100:00100000:1.0:1787579560.480599:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579560.482591:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591752576 00000100:00100000:2.0:1787579560.482610:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591752576 00000100:00100000:2.0:1787579560.482706:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 85 00000100:00100000:2.0:1787579560.482720:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf63c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+9:13782:x1874412591752576:12345-192.168.206.53@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787579560.482751:0:14492:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787579560.482851:0:14492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787579560.482857:0:14492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787579560.482860:0:14492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787579560.482863:0:14492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1787579560.503810:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf63c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+9:13782:x1874412591752576:12345-192.168.206.53@tcp:256:mount.lustre.0 Request processed in 21076us (23208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579560.503829:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 85 00000100:00100000:0.0:1787579560.516798:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579560.516918:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591752704 00000100:00100000:1.0:1787579560.516973:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591752704 00000100:00100000:1.0:1787579560.517043:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 86 00000100:00100000:1.0:1787579560.517074:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf63d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+9:13782:x1874412591752704:12345-192.168.206.53@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787579560.517096:0:14494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579560.517127:0:14494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0cd8351f400/0xb72beeaffa1b80fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d315 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579560.517162:0:14494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0cd8351f400/0xb72beeaffa1b80fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d315 expref: 10 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579560.517175:0:14494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0cd8351f400/0xb72beeaffa1b80fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d315 expref: 10 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579560.517196:0:14494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0cd8351f400, rc 0) 00000100:00100000:1.0:1787579560.517261:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf63d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+10:13782:x1874412591752704:12345-192.168.206.53@tcp:101:mount.lustre.0 Request processed in 190us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579560.517268:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 86 00000100:00100000:0.0:1787579560.530626:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579560.530803:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591752832 00000100:00100000:1.0:1787579560.530816:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591752832 00000100:00100000:1.0:1787579560.530886:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 87 00000100:00100000:1.0:1787579560.530897:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf63d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+10:13782:x1874412591752832:12345-192.168.206.53@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787579560.531666:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf63d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+10:13782:x1874412591752832:12345-192.168.206.53@tcp:501:mount.lustre.0 Request processed in 766us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579560.531679:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 87 00000100:00100000:0.0:1787579560.536064:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579560.536295:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591752960 00000100:00100000:3.0:1787579560.536308:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591752960 00000100:00100000:3.0:1787579560.536371:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 88 00000100:00100000:3.0:1787579560.536382:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf63f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+10:13782:x1874412591752960:12345-192.168.206.53@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787579560.536820:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf63f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+10:13782:x1874412591752960:12345-192.168.206.53@tcp:503:mount.lustre.0 Request processed in 438us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579560.536830:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 88 00000100:00100000:2.0:1787579560.540569:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579560.541194:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591753088 00000100:00100000:1.0:1787579560.541208:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591753088 00000100:00100000:1.0:1787579560.541287:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 89 00000100:00100000:1.0:1787579560.541300:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf63fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+10:13805:x1874412591753088:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787579560.541720:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf63fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+10:13805:x1874412591753088:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 421us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579560.541736:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 89 00000100:00100000:0.0:1787579560.570157:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579560.570368:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591753216 00000100:00100000:2.0:1787579560.570381:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591753216 00000100:00100000:2.0:1787579560.570455:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 90 00000100:00100000:2.0:1787579560.570466:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf63ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+10:13805:x1874412591753216:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787579560.570771:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf63ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+10:13805:x1874412591753216:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 306us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579560.570780:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 90 00000100:00100000:1.0:1787579560.603635:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579560.603754:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591753344 00000100:00100000:0.0:1787579560.603768:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591753344 00000100:00100000:0.0:1787579560.603826:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 4 00000100:00100000:0.0:1787579560.603835:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb4688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2358:x1874412591753344:12345-192.168.206.53@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787579560.603881:0:14501:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 8f2a5beb-cf32-4efe-802b-47d95029e6c6@192.168.206.53@tcp t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:0.0:1787579560.604009:0:14501:0:(genops.c:1385:class_connect()) connect: client 8f2a5beb-cf32-4efe-802b-47d95029e6c6, cookie 0xb72beeaffa1b8103 00000004:00100000:0.0:1787579560.604050:0:14501:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787579560.604057:0:14501:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1787579560.715064:0:14501:0:(import.c:65:import_set_state_nolock()) ffffa0cec1e5a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787579560.715186:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb4688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+6:2358:x1874412591753344:12345-192.168.206.53@tcp:38:mount.lustre.0 Request processed in 111337us (111553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579560.715201:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 4 00000100:00100000:2.0:1787579560.719017:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579560.719080:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591753600 00000100:00100000:1.0:1787579560.719097:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591753600 00000100:00100000:1.0:1787579560.719218:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:1.0:1787579560.719232:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+6:13782:x1874412591753600:12345-192.168.206.53@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787579560.719290:0:14500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1787579560.719380:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579560.719407:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+6:13782:x1874412591753600:12345-192.168.206.53@tcp:41:mount.lustre.0 Request processed in 176us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579560.719417:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:1.0:1787579560.721208:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579560.721390:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591753472 00000100:00100000:0.0:1787579560.721401:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591753472 00000100:00100000:0.0:1787579560.721471:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:0.0:1787579560.721483:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb468a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+6:0:x1874412591753472:12345-192.168.206.53@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787579560.721517:0:14501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787579560.721596:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb468a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+6:0:x1874412591753472:12345-192.168.206.53@tcp:41:mount.lustre.0 Request processed in 115us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579560.721605:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:3.0:1787579560.722910:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579560.723172:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591753728 00000100:00100000:1.0:1787579560.723199:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591753728 00000100:00100000:1.0:1787579560.723270:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:1.0:1787579560.723281:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+6:13782:x1874412591753728:12345-192.168.206.53@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787579560.723379:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+6:13782:x1874412591753728:12345-192.168.206.53@tcp:40:mount.lustre.0 Request processed in 100us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579560.723387:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:2.0:1787579560.731969:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579560.732003:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579560.732031:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579560.732124:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591754112 00000100:00100000:1.0:1787579560.732133:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591754112 00000100:00100000:1.0:1787579560.732186:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:1.0:1787579560.732196:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+6:13782:x1874412591754112:12345-192.168.206.53@tcp:33:mount.lustre.0 00000100:00100000:3.0:1787579560.732519:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591753856 00000100:00100000:3.0:1787579560.732526:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591753856 00000100:00100000:3.0:1787579560.732552:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591753984 00000100:00100000:3.0:1787579560.732555:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591753984 00000100:00100000:3.0:1787579560.732575:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:3.0:1787579560.732581:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1874412591753856:12345-192.168.206.53@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787579560.732617:0:15185:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 8f2a5beb-cf32-4efe-802b-47d95029e6c6@192.168.206.53@tcp t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:3.0:1787579560.732644:0:15185:0:(genops.c:1385:class_connect()) connect: client 8f2a5beb-cf32-4efe-802b-47d95029e6c6, cookie 0xb72beeaffa1b810a 00002000:00100000:3.0:1787579560.732655:0:15185:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8f2a5beb-cf32-4efe-802b-47d95029e6c6/ffffa0ceb3138000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787579560.732666:0:15185:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000004:00080000:1.0:1787579560.732895:0:14503:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 631us 00002000:00080000:3.0:1787579560.733074:0:15185:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787579560.733103:0:15185:0:(import.c:65:import_set_state_nolock()) ffffa0ceb313f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787579560.733165:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+6:2358:x1874412591753856:12345-192.168.206.53@tcp:8:mount.lustre.0 Request processed in 582us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579560.733174:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:3.0:1787579560.733208:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:3.0:1787579560.733214:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1874412591753984:12345-192.168.206.53@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787579560.733230:0:15185:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 8f2a5beb-cf32-4efe-802b-47d95029e6c6@192.168.206.53@tcp t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:3.0:1787579560.733247:0:15185:0:(genops.c:1385:class_connect()) connect: client 8f2a5beb-cf32-4efe-802b-47d95029e6c6, cookie 0xb72beeaffa1b8111 00002000:00100000:3.0:1787579560.733254:0:15185:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8f2a5beb-cf32-4efe-802b-47d95029e6c6/ffffa0ceb313d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787579560.733394:0:15185:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787579560.733762:0:15185:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787579560.733782:0:15185:0:(import.c:65:import_set_state_nolock()) ffffa0ceb313f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787579560.733811:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+6:2358:x1874412591753984:12345-192.168.206.53@tcp:8:mount.lustre.0 Request processed in 596us (1806us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579560.733819:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 11 00000004:00200000:2.0:1787579560.744840:0:14503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787579560.745625:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+6:13782:x1874412591754112:12345-192.168.206.53@tcp:33:mount.lustre.0 Request processed in 13424us (13586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579560.745641:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 0 00010000:00010000:0.0:1787579560.864479:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579560.928376:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616909952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787579560.928491:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579560.928752:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616910208:0@lo:400:kworker.0 00000100:00100000:0.0:1787579560.928789:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579560.928985:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874412616910336:0@lo:400:kworker.0 00000100:00100000:3.0:1787579560.929023:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579560.929110:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6514e2d9-be54-4793-9feb-dcbd6b926656:3322:1874412616910080:0@lo:400:kworker.0 00000100:00100000:2.0:1787579560.929164:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579560.934084:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616910464:0@lo:400:kworker.0 00000100:00100000:1.0:1787579560.934205:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579560.934296:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616909952 00000100:00100000:1.0:1787579560.934307:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616909952 00000100:00100000:1.0:1787579560.934401:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787579560.934412:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb468b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616909952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787579560.934444:0:15188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787579560.934500:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb468b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616909952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (6009us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579560.934508:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787579560.934536:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616910336 00000100:00100000:1.0:1787579560.934540:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616910336 00000100:00100000:1.0:1787579560.934568:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616910464 00000100:00100000:1.0:1787579560.934571:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616910464 00000100:00100000:1.0:1787579560.934587:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787579560.934594:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874412616910336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579560.934633:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874412616910336:12345-0@lo:400:kworker.0 Request processed in 39us (5609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579560.934640:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787579560.934651:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787579560.934658:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616910464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579560.934684:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616910464:12345-0@lo:400:kworker.0 Request processed in 26us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579560.934690:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787579560.935047:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ce84f15c00 x1874412616910464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579560.935088:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616910464:0@lo:400:kworker.0 00000100:00100000:1.0:1787579560.935104:0:3321:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787579560.935129:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616909952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787579560.935745:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616910208 00000100:00100000:3.0:1787579560.935761:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616910208 00000100:00100000:3.0:1787579560.935798:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787579560.935806:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616910208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579560.935866:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616910208:12345-0@lo:400:kworker.0 Request processed in 61us (7076us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579560.935873:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787579560.935908:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ce84f14000 x1874412616910336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579560.935947:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874412616910336:0@lo:400:kworker.0 00000100:00100000:3.0:1787579560.935988:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616910080 00000100:00100000:3.0:1787579560.935992:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616910080 00000100:00100000:3.0:1787579560.936028:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787579560.936035:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf63e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+19:3322:x1874412616910080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579560.936070:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf63e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+19:3322:x1874412616910080:12345-0@lo:400:kworker.0 Request processed in 36us (6906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579560.936076:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1787579560.936112:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787579560.936118:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787579560.936324:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6514e2d9-be54-4793-9feb-dcbd6b926656:3322:1874412616910080:0@lo:400:kworker.0 00000100:00100000:2.0:1787579560.936338:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3322:1874412616910592:0@lo:400:kworker.0 00000100:00100000:2.0:1787579560.936380:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579560.938432:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616910592 00000100:00100000:3.0:1787579560.938449:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616910592 00000100:00100000:3.0:1787579560.938523:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787579560.938534:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1874412616910592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579560.938650:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1874412616910592:12345-0@lo:400:kworker.0 Request processed in 118us (2268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579560.938659:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1787579560.938684:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787579560.939029:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ce84f14380 x1874412616910592/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579560.939047:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3322:1874412616910592:0@lo:400:kworker.0 00000100:00100000:0.0:1787579560.943502:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616910208:0@lo:400:kworker.0 00000100:00100000:0.0:1787579560.952656:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579560.953123:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591754240 00000100:00100000:3.0:1787579560.953154:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591754240 00000100:00100000:3.0:1787579560.953335:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:3.0:1787579560.953347:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+6:13826:x1874412591754240:12345-192.168.206.53@tcp:101:mkdir.0 00010000:00010000:3.0:1787579560.953371:0:14502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579560.953404:0:14502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01a00/0xb72beeaffa1b8118 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d33f expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579560.953481:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00e00/0xb72beeaffa1b811f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579560.953496:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00e00/0xb72beeaffa1b811f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579560.953513:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00e00/0xb72beeaffa1b811f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579560.953809:0:14502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787579560.953815:0:14502:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787579560.954143:0:14502:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00e00/0xb72beeaffa1b811f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579560.954366:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01a00/0xb72beeaffa1b8118 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d33f expref: 8 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579560.954391:0:14502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00e00/0xb72beeaffa1b811f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d33f expref: 7 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579560.954401:0:14502:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce96a86c00) 00010000:00010000:3.0:1787579560.954404:0:14502:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787579560.954408:0:14502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0cd82a00e00, rc 0) 00000100:00100000:2.0:1787579560.954702:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+7:13826:x1874412591754240:12345-192.168.206.53@tcp:101:mkdir.0 Request processed in 1354us (2057us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579560.954711:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 8 00000001:00100000:2.0:1787579561.517279:0:7670:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8f2a5beb-cf32-4efe-802b-47d95029e6c6 00010000:00010000:3.0:1787579561.888215:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579562.913079:0:16123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579563.186091:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579563.186587:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591754368 00000100:00100000:1.0:1787579563.186601:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591754368 00000100:00100000:1.0:1787579563.186681:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00100000:1.0:1787579563.186695:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+7:13878:x1874412591754368:12345-192.168.206.53@tcp:41:lfs.0 00000004:00000024:1.0:1787579563.186734:0:14501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1787579563.186762:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579563.187028:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+7:13878:x1874412591754368:12345-192.168.206.53@tcp:41:lfs.0 Request processed in 336us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579563.187037:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00100000:3.0:1787579563.197785:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579563.197978:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591754496 00000100:00100000:1.0:1787579563.197991:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591754496 00000100:00080000:3.0:1787579563.198159:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787579563.198593:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:1.0:1787579563.198609:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8f2a5beb-cf32-4efe-802b-47d95029e6c6+6:13878:x1874412591754496:12345-192.168.206.53@tcp:13:lfs.0 00002000:00000024:1.0:1787579563.198659:0:15188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787579563.198773:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8f2a5beb-cf32-4efe-802b-47d95029e6c6+6:13878:x1874412591754496:12345-192.168.206.53@tcp:13:lfs.0 Request processed in 169us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579563.198782:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:3.0:1787579563.209021:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579563.213750:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591754624 00000100:00100000:0.0:1787579563.213769:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591754624 00000100:00080000:3.0:1787579563.213893:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787579563.214075:0:15189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:0.0:1787579563.214087:0:15189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8f2a5beb-cf32-4efe-802b-47d95029e6c6+5:13878:x1874412591754624:12345-192.168.206.53@tcp:13:lfs.0 00002000:00000024:0.0:1787579563.214203:0:15189:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579563.214680:0:15189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8f2a5beb-cf32-4efe-802b-47d95029e6c6+5:13878:x1874412591754624:12345-192.168.206.53@tcp:13:lfs.0 Request processed in 594us (5672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579563.214688:0:15189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:3.0:1787579563.431073:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579563.431203:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591754752 00000100:00100000:0.0:1787579563.431215:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591754752 00000100:00100000:0.0:1787579563.431353:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 92 00000100:00100000:0.0:1787579563.431366:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf63f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+10:13909:x1874412591754752:12345-192.168.206.53@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787579563.431387:0:14492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579563.431411:0:14492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceba3c9000/0xb72beeaffa1b8126 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d346 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579563.431447:0:14492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceba3c9000/0xb72beeaffa1b8126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d346 expref: 11 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579563.431460:0:14492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceba3c9000/0xb72beeaffa1b8126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d346 expref: 11 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579563.431470:0:14492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c9000, rc 0) 00000100:00100000:0.0:1787579563.431552:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf63f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+11:13909:x1874412591754752:12345-192.168.206.53@tcp:101:mount.lustre.0 Request processed in 188us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579563.431561:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 92 00000100:00100000:2.0:1787579563.434002:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579563.434132:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591754880 00000100:00100000:3.0:1787579563.434144:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591754880 00000100:00100000:3.0:1787579563.434219:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 93 00000100:00100000:3.0:1787579563.434230:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf63e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+11:13909:x1874412591754880:12345-192.168.206.53@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787579563.434730:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf63e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+11:13909:x1874412591754880:12345-192.168.206.53@tcp:501:mount.lustre.0 Request processed in 499us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579563.434740:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 93 00000100:00100000:2.0:1787579563.446792:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579563.446881:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591755008 00000100:00100000:3.0:1787579563.446893:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591755008 00000100:00100000:3.0:1787579563.446998:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 94 00000100:00100000:3.0:1787579563.447011:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf63f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+11:13909:x1874412591755008:12345-192.168.206.53@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787579563.447619:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf63f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+11:13909:x1874412591755008:12345-192.168.206.53@tcp:503:mount.lustre.0 Request processed in 608us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579563.447628:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 94 00000100:00100000:2.0:1787579563.490317:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579563.490406:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591755136 00000100:00100000:3.0:1787579563.490424:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591755136 00000100:00100000:3.0:1787579563.490503:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 95 00000100:00100000:3.0:1787579563.490515:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3d41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+11:13916:x1874412591755136:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787579563.495869:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3d41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+11:13916:x1874412591755136:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 5346us (5550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579563.495883:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 95 00000100:00100000:2.0:1787579563.516020:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579563.516280:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591755264 00000100:00100000:3.0:1787579563.516313:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591755264 00000100:00100000:3.0:1787579563.516387:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 96 00000100:00100000:3.0:1787579563.516397:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3d42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+11:13916:x1874412591755264:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787579563.516783:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3d42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+11:13916:x1874412591755264:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 386us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579563.516791:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 96 00000100:00100000:0.0:1787579563.522056:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579563.524191:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591755392 00000100:00100000:2.0:1787579563.524217:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591755392 00000100:00100000:2.0:1787579563.524312:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 97 00000100:00100000:2.0:1787579563.524325:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3d42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+11:13909:x1874412591755392:12345-192.168.206.53@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787579563.524349:0:14494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579563.524376:0:14494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceba319000/0xb72beeaffa1b812d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d370 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579563.529319:0:14494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceba319000/0xb72beeaffa1b812d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d370 expref: 12 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579563.529343:0:14494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceba319000/0xb72beeaffa1b812d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d370 expref: 12 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579563.529354:0:14494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319000, rc 0) 00000100:00100000:2.0:1787579563.529447:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3d42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+12:13909:x1874412591755392:12345-192.168.206.53@tcp:101:mount.lustre.0 Request processed in 5123us (7405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579563.529456:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 97 00000100:00100000:2.0:1787579563.533920:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579563.534285:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591755520 00000100:00100000:0.0:1787579563.534295:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591755520 00000100:00100000:0.0:1787579563.534345:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 98 00000100:00100000:0.0:1787579563.534354:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3d40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+12:13909:x1874412591755520:12345-192.168.206.53@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787579563.534384:0:14492:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787579563.534409:0:14492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787579563.534413:0:14492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787579563.534416:0:14492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787579563.534419:0:14492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787579563.536488:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3d40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+12:13909:x1874412591755520:12345-192.168.206.53@tcp:256:mount.lustre.0 Request processed in 2120us (2561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579563.536508:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 98 00000100:00100000:2.0:1787579563.553865:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579563.553992:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591755648 00000100:00100000:0.0:1787579563.554009:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591755648 00000100:00100000:0.0:1787579563.554091:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 99 00000100:00100000:0.0:1787579563.554112:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+12:13909:x1874412591755648:12345-192.168.206.53@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787579563.554134:0:14494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579563.554159:0:14494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceba3c8200/0xb72beeaffa1b8134 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d377 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579563.554208:0:14494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceba3c8200/0xb72beeaffa1b8134 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d377 expref: 13 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579563.554220:0:14494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceba3c8200/0xb72beeaffa1b8134 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d377 expref: 13 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579563.554230:0:14494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c8200, rc 0) 00000100:00100000:0.0:1787579563.554311:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+13:13909:x1874412591755648:12345-192.168.206.53@tcp:101:mount.lustre.0 Request processed in 202us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579563.554319:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 99 00000100:00100000:2.0:1787579563.566796:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579563.567585:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591755776 00000100:00100000:0.0:1787579563.567594:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591755776 00000100:00100000:0.0:1787579563.567649:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 100 00000100:00100000:0.0:1787579563.567659:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3d40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+13:13909:x1874412591755776:12345-192.168.206.53@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787579563.569379:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3d40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+13:13909:x1874412591755776:12345-192.168.206.53@tcp:501:mount.lustre.0 Request processed in 1713us (2583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579563.569391:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 100 00000100:00100000:2.0:1787579563.572720:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579563.572814:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591755904 00000100:00100000:3.0:1787579563.572823:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591755904 00000100:00100000:3.0:1787579563.572870:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 101 00000100:00100000:3.0:1787579563.572880:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+13:13909:x1874412591755904:12345-192.168.206.53@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787579563.573222:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+13:13909:x1874412591755904:12345-192.168.206.53@tcp:503:mount.lustre.0 Request processed in 342us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579563.573231:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 101 00000100:00100000:2.0:1787579563.577488:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579563.577645:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591756032 00000100:00100000:0.0:1787579563.577654:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591756032 00000100:00100000:0.0:1787579563.577744:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 102 00000100:00100000:0.0:1787579563.577754:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+13:13922:x1874412591756032:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787579563.578061:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+13:13922:x1874412591756032:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 307us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579563.578071:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 102 00000100:00100000:2.0:1787579563.587694:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579563.587814:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591756160 00000100:00100000:3.0:1787579563.587823:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591756160 00000100:00100000:2.0:1787579563.587958:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 103 00000100:00100000:2.0:1787579563.587970:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3d41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+13:13922:x1874412591756160:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787579563.588232:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3d41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+13:13922:x1874412591756160:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 265us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579563.588241:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 103 00000100:00100000:2.0:1787579563.610830:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579563.611034:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591756288 00000100:00100000:3.0:1787579563.611044:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591756288 00000100:00100000:3.0:1787579563.611093:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:3.0:1787579563.611101:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2358:x1874412591756288:12345-192.168.206.53@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787579563.611140:0:14502:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 7d4886d1-0f39-4e88-a51d-0bd8227c58f4@192.168.206.53@tcp t0 exp 0000000000000000 cur 499 last 0 00000020:00000080:3.0:1787579563.611206:0:14502:0:(genops.c:1385:class_connect()) connect: client 7d4886d1-0f39-4e88-a51d-0bd8227c58f4, cookie 0xb72beeaffa1b813b 00000004:00100000:3.0:1787579563.611234:0:14502:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787579563.611348:0:14502:0:(import.c:65:import_set_state_nolock()) ffffa0ce85760000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787579563.611420:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+6:2358:x1874412591756288:12345-192.168.206.53@tcp:38:mount.lustre.0 Request processed in 318us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579563.611428:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:1.0:1787579563.628300:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579563.628499:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591756416 00000100:00100000:2.0:1787579563.628507:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591756416 00000100:00100000:2.0:1787579563.628623:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:2.0:1787579563.628633:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+6:0:x1874412591756416:12345-192.168.206.53@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787579563.628663:0:14501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787579563.628731:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+6:0:x1874412591756416:12345-192.168.206.53@tcp:41:mount.lustre.0 Request processed in 100us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579563.628739:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00080000:3.0:1787579563.630175:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579563.635278:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579563.639360:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591756544 00000100:00100000:2.0:1787579563.639375:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591756544 00000100:00100000:2.0:1787579563.639448:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:2.0:1787579563.639458:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+6:13909:x1874412591756544:12345-192.168.206.53@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787579563.639488:0:14500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787579563.639570:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+6:13909:x1874412591756544:12345-192.168.206.53@tcp:41:mount.lustre.0 Request processed in 113us (4300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579563.639578:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:1.0:1787579563.642335:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579563.644694:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591756672 00000100:00100000:0.0:1787579563.644708:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591756672 00000100:00100000:0.0:1787579563.644770:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 13 00000100:00100000:0.0:1787579563.644780:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+6:13909:x1874412591756672:12345-192.168.206.53@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787579563.644883:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+6:13909:x1874412591756672:12345-192.168.206.53@tcp:40:mount.lustre.0 Request processed in 93us (2545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579563.644890:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 13 00000100:00100000:3.0:1787579563.647616:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579563.647660:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579563.647705:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579563.647736:0:15186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591756800 00000100:00100000:3.0:1787579563.647743:0:15186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591756800 00000100:00100000:3.0:1787579563.647775:0:15186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591756928 00000100:00100000:3.0:1787579563.647778:0:15186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591756928 00000100:00100000:3.0:1787579563.647794:0:15186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:3.0:1787579563.647802:0:15186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1874412591756800:12345-192.168.206.53@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787579563.647831:0:15186:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 7d4886d1-0f39-4e88-a51d-0bd8227c58f4@192.168.206.53@tcp t0 exp 0000000000000000 cur 499 last 0 00000020:00000080:3.0:1787579563.647864:0:15186:0:(genops.c:1385:class_connect()) connect: client 7d4886d1-0f39-4e88-a51d-0bd8227c58f4, cookie 0xb72beeaffa1b8142 00002000:00100000:3.0:1787579563.647875:0:15186:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7d4886d1-0f39-4e88-a51d-0bd8227c58f4/ffffa0ce85765800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787579563.647885:0:15186:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787579563.648385:0:15186:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787579563.648412:0:15186:0:(import.c:65:import_set_state_nolock()) ffffa0ce85761800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787579563.648470:0:15186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+6:2358:x1874412591756800:12345-192.168.206.53@tcp:8:mount.lustre.0 Request processed in 666us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579563.648477:0:15186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:3.0:1787579563.648495:0:15186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 13 00000100:00100000:3.0:1787579563.648500:0:15186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1874412591756928:12345-192.168.206.53@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787579563.648515:0:15186:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7d4886d1-0f39-4e88-a51d-0bd8227c58f4@192.168.206.53@tcp t0 exp 0000000000000000 cur 499 last 0 00000020:00000080:3.0:1787579563.648531:0:15186:0:(genops.c:1385:class_connect()) connect: client 7d4886d1-0f39-4e88-a51d-0bd8227c58f4, cookie 0xb72beeaffa1b8149 00002000:00100000:3.0:1787579563.648537:0:15186:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7d4886d1-0f39-4e88-a51d-0bd8227c58f4/ffffa0ce85765000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787579563.648542:0:15186:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1787579563.648749:0:14504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591757056 00000100:00100000:1.0:1787579563.648755:0:14504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591757056 00000100:00100000:1.0:1787579563.648786:0:14504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 1 00000100:00100000:1.0:1787579563.648792:0:14504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+6:13909:x1874412591757056:12345-192.168.206.53@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787579563.649043:0:14504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787579563.649171:0:14504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+6:13909:x1874412591757056:12345-192.168.206.53@tcp:33:mount.lustre.0 Request processed in 368us (1553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579563.649178:0:14504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 1 00002000:00080000:1.0:1787579563.652731:0:15186:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787579563.652770:0:15186:0:(import.c:65:import_set_state_nolock()) ffffa0cebf7fe800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787579563.652836:0:15186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+6:2358:x1874412591756928:12345-192.168.206.53@tcp:8:mount.lustre.0 Request processed in 4333us (5128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579563.652847:0:15186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 13 00010000:00010000:1.0:1787579563.936107:0:16124:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579563.947222:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579563.947368:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591757184 00000100:00100000:1.0:1787579563.947376:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591757184 00000100:00100000:1.0:1787579563.947429:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 14 00000100:00100000:1.0:1787579563.947439:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8923aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+6:13944:x1874412591757184:12345-192.168.206.53@tcp:101:mkdir.0 00010000:00010000:1.0:1787579563.947457:0:14501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579563.947477:0:14501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351e800/0xb72beeaffa1b8150 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d3a1 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579563.947530:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b8157 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579563.947543:0:14501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b8157 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579563.947553:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b8157 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787579563.947730:0:14501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787579563.947734:0:14501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787579563.947800:0:14501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b8157 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579563.947824:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351e800/0xb72beeaffa1b8150 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3a1 expref: 8 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579563.947839:0:14501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b8157 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3a1 expref: 7 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579563.947847:0:14501:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce96a86c00) 00010000:00010000:1.0:1787579563.947850:0:14501:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787579563.947854:0:14501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0cd8351ea00, rc 0) 00000100:00100000:1.0:1787579563.947909:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8923aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+7:13944:x1874412591757184:12345-192.168.206.53@tcp:101:mkdir.0 Request processed in 471us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579563.947917:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 14 00000001:00100000:3.0:1787579564.047104:0:6735:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7d4886d1-0f39-4e88-a51d-0bd8227c58f4 00000001:00100000:3.0:1787579564.047118:0:6735:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8f2a5beb-cf32-4efe-802b-47d95029e6c6 00000100:00100000:3.0:1787579564.514366:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787579564.514387:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616910720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787579564.514451:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579564.514583:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616910720 00000100:00100000:1.0:1787579564.514591:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616910720 00000100:00100000:1.0:1787579564.514651:0:15189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787579564.514661:0:15189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8923b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616910720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787579564.514680:0:15189:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787579564.514729:0:15189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8923b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616910720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579564.514736:0:15189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787579564.514776:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616910720:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787579564.514856:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787579564.965726:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787579565.672040:0:14534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787579565.984213:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579566.048599:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787579566.048618:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616910848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787579566.048677:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579566.048874:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616911104:0@lo:400:kworker.0 00000100:00100000:3.0:1787579566.048917:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579566.048954:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787579566.048960:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6514e2d9-be54-4793-9feb-dcbd6b926656:3322:1874412616910976:0@lo:400:kworker.0 00000100:00100000:3.0:1787579566.048985:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579566.049007:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec176b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3322:1874412616911488:0@lo:400:kworker.0 00000100:00100000:3.0:1787579566.049035:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579566.049068:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616910976 00000100:00100000:3.0:1787579566.049075:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616910976 00000100:00100000:0.0:1787579566.049098:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616911232:0@lo:400:kworker.0 00000100:00100000:0.0:1787579566.049122:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579566.049128:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787579566.049137:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3d40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+19:3322:x1874412616910976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579566.049138:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787579566.049162:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616911360:0@lo:400:kworker.0 00000100:00100000:0.0:1787579566.049180:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579566.049191:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3d40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+19:3322:x1874412616910976:12345-0@lo:400:kworker.0 Request processed in 55us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579566.049199:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787579566.049201:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616911488 00000100:00100000:0.0:1787579566.049204:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616911488 00000100:00100000:3.0:1787579566.049243:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6514e2d9-be54-4793-9feb-dcbd6b926656:3322:1874412616910976:0@lo:400:kworker.0 00000100:00100000:1.0:1787579566.049377:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616910848 00000100:00100000:1.0:1787579566.049382:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616910848 00000100:00100000:1.0:1787579566.049416:0:15189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787579566.049422:0:15189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616910848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787579566.049456:0:15189:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787579566.049499:0:15189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616910848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579566.049505:0:15189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787579566.049625:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616911104 00000100:00100000:1.0:1787579566.049629:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616911104 00000100:00100000:1.0:1787579566.049655:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787579566.049661:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616911104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579566.050029:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616911232 00000100:00100000:3.0:1787579566.050034:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616911232 00000100:00100000:0.0:1787579566.050303:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616911360 00000100:00100000:0.0:1787579566.050307:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616911360 00000100:00100000:1.0:1787579566.050958:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616911104:12345-0@lo:400:kworker.0 Request processed in 1293us (2036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579566.050967:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787579566.051026:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787579566.051664:0:14500:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787579566.051672:0:14500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:3.0:1787579566.051721:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787579566.051727:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787579566.051730:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787579566.051768:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616911104:0@lo:400:kworker.0 00000100:00100000:2.0:1787579566.054290:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616910848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787579566.054726:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787579566.054739:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616911232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579566.054817:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616911232:12345-0@lo:400:kworker.0 Request processed in 82us (5694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579566.054825:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787579566.054890:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616911232:0@lo:400:kworker.0 00000100:00100000:0.0:1787579566.056049:0:14502:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787579566.056062:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787579566.056072:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616911360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579566.056129:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874412616911360:12345-0@lo:400:kworker.0 Request processed in 60us (6947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579566.056136:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787579566.056180:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3319:1874412616911360:0@lo:400:kworker.0 00000100:00080000:2.0:1787579566.059803:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579566.060920:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8923b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1874412616911488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579566.061034:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8923b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1874412616911488:12345-0@lo:400:kworker.0 Request processed in 10000us (11997us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579566.061044:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787579566.061101:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec176b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3322:1874412616911488:0@lo:400:kworker.0 00000001:00100000:0.0:1787579566.123224:0:5888:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8f2a5beb-cf32-4efe-802b-47d95029e6c6 00000001:00100000:0.0:1787579566.123369:0:5888:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7d4886d1-0f39-4e88-a51d-0bd8227c58f4 00000001:00100000:2.0:1787579566.626336:0:7670:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7d4886d1-0f39-4e88-a51d-0bd8227c58f4 00010000:00010000:2.0:1787579567.014986:0:16123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787579567.062376:0:16471:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787579568.032053:0:16124:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579568.826570:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579568.826609:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579568.826660:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579568.826697:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591757440 00000100:00100000:2.0:1787579568.826706:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591757440 00000100:00100000:2.0:1787579568.826762:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 22 00000100:00100000:2.0:1787579568.826772:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+6:2362:x1874412591757440:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1787579568.826842:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+6:2362:x1874412591757440:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 72us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579568.826849:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 22 00000100:00080000:2.0:1787579568.826872:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579568.838465:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579568.838503:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591757312 00000100:00100000:0.0:1787579568.838512:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591757312 00000100:00100000:0.0:1787579568.838559:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 105 00000100:00100000:0.0:1787579568.838568:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3d43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+13:2362:x1874412591757312:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579568.838632:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3d43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+13:2362:x1874412591757312:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 64us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579568.838639:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 105 00000100:00100000:0.0:1787579568.838689:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579568.840328:0:15485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591757696 00000100:00100000:3.0:1787579568.840341:0:15485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591757696 00000100:00100000:3.0:1787579568.840401:0:15485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591757952 00000100:00100000:3.0:1787579568.840405:0:15485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591757952 00000100:00100000:3.0:1787579568.840431:0:15485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:3.0:1787579568.840440:0:15485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+5:2362:x1874412591757696:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1787579568.842608:0:15485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+5:2362:x1874412591757696:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 2158us (15987us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579568.842623:0:15485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:3.0:1787579568.842659:0:15485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:3.0:1787579568.842670:0:15485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+5:2362:x1874412591757952:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1787579568.842724:0:15485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+5:2362:x1874412591757952:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 58us (16063us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579568.842730:0:15485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:0.0:1787579568.843626:0:15485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591757568 00000100:00100000:0.0:1787579568.843636:0:15485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591757568 00000100:00100000:0.0:1787579568.843672:0:15485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:0.0:1787579568.843680:0:15485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+5:2362:x1874412591757568:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579568.843717:0:15485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+5:2362:x1874412591757568:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 38us (5028us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579568.843724:0:15485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00080000:0.0:1787579568.849021:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787579568.849029:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787579568.850380:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579568.850430:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579568.850470:0:15485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591758080 00000100:00100000:1.0:1787579568.850479:0:15485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591758080 00000100:00100000:1.0:1787579568.850555:0:15485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:1.0:1787579568.850564:0:15485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+5:2362:x1874412591758080:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579568.850623:0:15485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+5:2362:x1874412591758080:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 60us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579568.850629:0:15485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00080000:1.0:1787579568.850648:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787579568.852541:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591757824 00000100:00100000:0.0:1787579568.852553:0:16432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591757824 00000100:00100000:0.0:1787579568.852611:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 23 00000100:00100000:0.0:1787579568.852620:0:16432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+6:2362:x1874412591757824:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579568.852681:0:16432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+6:2362:x1874412591757824:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 62us (2308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579568.852688:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 23 00000100:00080000:0.0:1787579568.852708:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787579569.059943:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579569.632445:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616911616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787579569.632553:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579569.632685:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616911616 00000100:00100000:1.0:1787579569.632693:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616911616 00000100:00100000:1.0:1787579569.632750:0:15189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787579569.632759:0:15189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89239f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616911616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787579569.632794:0:15189:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787579569.632853:0:15189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89239f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616911616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579569.632860:0:15189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1787579569.634247:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787579569.634302:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616911616:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787579570.080311:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787579571.051212:0:16619:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc8cd2f330 20000000:00000080:1.0:1787579571.051352:0:16619:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0cec1f80000 uarg=0000000000000000 20000000:01000000:1.0:1787579571.051388:0:16619:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787579571.051394:0:16619:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787579571.051399:0:16619:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787579571.053100:0:16620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1787579571.053491:0:16619:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787579571.064183:0:16619:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787579571.064288:0:16619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0ceba3c8000/0xb72beeaffa1b815e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579571.064318:0:16619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ce90a8a800/0xb72beeaffa1b7e55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b7e4e expref: 18 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579571.064327:0:16619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ce90a8b800/0xb72beeaffa1b7ea2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b7e9b expref: 18 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579571.064334:0:16619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ceba3c9e00/0xb72beeaffa1b7fdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b7fd6 expref: 18 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579571.064366:0:16619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0cd8351f400/0xb72beeaffa1b80fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d315 expref: 12 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579571.064374:0:16619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0ceba3c8200/0xb72beeaffa1b8134 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d377 expref: 12 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579571.064382:0:16619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0ceba3c8000/0xb72beeaffa1b815e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579571.064442:0:16619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ceba3c8200/0xb72beeaffa1b8134 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d377 expref: 12 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579571.064462:0:16619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0ceba3c8200/0xb72beeaffa1b8134 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d377 expref: 12 pid: 14494 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579571.064482:0:16619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f15880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16619:1874412616911744:192.168.206.53@tcp:104: 00010000:00010000:0.0:1787579571.064641:0:16619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0cd8351f400/0xb72beeaffa1b80fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d315 expref: 12 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579571.064650:0:16619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0cd8351f400/0xb72beeaffa1b80fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d315 expref: 12 pid: 14494 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579571.064660:0:16619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f14e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16619:1874412616911872:192.168.206.53@tcp:104: 00010000:00010000:0.0:1787579571.064694:0:16619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ceba3c9e00/0xb72beeaffa1b7fdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b7fd6 expref: 18 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579571.064702:0:16619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0ceba3c9e00/0xb72beeaffa1b7fdd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b7fd6 expref: 18 pid: 14494 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579571.064727:0:16619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f17800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16619:1874412616912000:0@lo:104: 00000100:00100000:0.0:1787579571.064783:0:16619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787579571.064839:0:16619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ce90a8b800/0xb72beeaffa1b7ea2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b7e9b expref: 18 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579571.064859:0:16619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0ce90a8b800/0xb72beeaffa1b7ea2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b7e9b expref: 18 pid: 14495 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579571.064869:0:16619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f15180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16619:1874412616912128:0@lo:104: 00000100:00100000:0.0:1787579571.064894:0:16619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787579571.064961:0:16619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0ce90a8a800/0xb72beeaffa1b7e55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb72beeaffa1b7e4e expref: 18 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579571.064971:0:16619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0ce90a8a800/0xb72beeaffa1b7e55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb72beeaffa1b7e4e expref: 18 pid: 14495 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579571.064979:0:16619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f14000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16619:1874412616912256:0@lo:104: 00000100:00100000:0.0:1787579571.065032:0:16619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579571.065043:0:16619:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce8613b600 going to sleep for 11 seconds 00000100:00100000:1.0:1787579571.065558:0:14483:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787579571.065581:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616912000 00000100:00100000:1.0:1787579571.065587:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616912000 00000100:00100000:1.0:1787579571.065621:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616912128 00000100:00100000:1.0:1787579571.065625:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616912128 00000100:00100000:1.0:1787579571.065636:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616912256 00000100:00100000:1.0:1787579571.065639:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616912256 00000100:00100000:1.0:1787579571.065662:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787579571.065684:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6514e2d9-be54-4793-9feb-dcbd6b926656+5:16619:x1874412616912000:12345-0@lo:104: 00010000:00010000:1.0:1787579571.065701:0:14483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b200/0xb72beeaffa1b7fd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b7fdd expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579571.067431:0:14483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787579571.067450:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6514e2d9-be54-4793-9feb-dcbd6b926656+5:16619:x1874412616912000:12345-0@lo:104: Request processed in 1762us (2662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579571.067466:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787579571.067518:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787579571.067531:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6514e2d9-be54-4793-9feb-dcbd6b926656+4:16619:x1874412616912128:12345-0@lo:104: 00010000:00010000:0.0:1787579571.067562:0:14483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c8000/0xb72beeaffa1b7e9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b7ea2 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579571.067679:0:14483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787579571.067685:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6514e2d9-be54-4793-9feb-dcbd6b926656+4:16619:x1874412616912128:12345-0@lo:104: Request processed in 160us (2791us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579571.067692:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787579571.067708:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787579571.067714:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce82be5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6514e2d9-be54-4793-9feb-dcbd6b926656+3:16619:x1874412616912256:12345-0@lo:104: 00010000:00010000:0.0:1787579571.067722:0:14483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8600/0xb72beeaffa1b7e4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b7e55 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579571.067768:0:14483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787579571.067773:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce82be5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6514e2d9-be54-4793-9feb-dcbd6b926656+3:16619:x1874412616912256:12345-0@lo:104: Request processed in 60us (2741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579571.067778:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787579571.067952:0:16123:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787579571.067961:0:16123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b200/0xb72beeaffa1b7fd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b7fdd expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579571.067969:0:16123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ce8148b200 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:2.0:1787579571.067974:0:16123:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b200/0xb72beeaffa1b7fd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b7fdd expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579571.067983:0:16123:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b200/0xb72beeaffa1b7fd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b7fdd expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787579571.067991:0:16123:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b200/0xb72beeaffa1b7fd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b7fdd expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579571.067997:0:16123:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787579571.068041:0:16123:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b200/0xb72beeaffa1b7fd6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b7fdd expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579571.068048:0:16123:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787579571.068075:0:16123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b200/0xb72beeaffa1b7fd6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b7fdd expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579571.068094:0:16123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ce8148b200/0xb72beeaffa1b7fd6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b7fdd expref: -99 pid: 15905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579571.068111:0:16123:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787579571.068114:0:16123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c8000/0xb72beeaffa1b7e9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b7ea2 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579571.068135:0:16123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceb47c8000 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:2.0:1787579571.068138:0:16123:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c8000/0xb72beeaffa1b7e9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b7ea2 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579571.068145:0:16123:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c8000/0xb72beeaffa1b7e9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b7ea2 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787579571.068152:0:16123:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c8000/0xb72beeaffa1b7e9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b7ea2 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579571.068156:0:16123:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787579571.068171:0:16123:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c8000/0xb72beeaffa1b7e9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b7ea2 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579571.068177:0:16123:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787579571.068186:0:16123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c8000/0xb72beeaffa1b7e9b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b7ea2 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579571.068203:0:16124:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787579571.068218:0:16123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ceb47c8000/0xb72beeaffa1b7e9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b7ea2 expref: -99 pid: 15182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579571.068231:0:16124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8600/0xb72beeaffa1b7e4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb72beeaffa1b7e55 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579571.068232:0:16123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579571.068240:0:16123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579571.068242:0:16123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579571.068263:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6514e2d9-be54-4793-9feb-dcbd6b926656:3319:1874412616912384:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787579571.068308:0:16124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8600 already unused, calling callback (ffffffffc1c71c20) 10000000:00010000:1.0:1787579571.068314:0:16124:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8600/0xb72beeaffa1b7e4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb72beeaffa1b7e55 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579571.068325:0:16124:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8600/0xb72beeaffa1b7e4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb72beeaffa1b7e55 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787579571.068333:0:16124:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8600/0xb72beeaffa1b7e4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb72beeaffa1b7e55 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579571.068338:0:16124:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787579571.068494:0:16124:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8600/0xb72beeaffa1b7e4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b7e55 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579571.068503:0:16124:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787579571.068519:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579571.068537:0:16124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8600/0xb72beeaffa1b7e4e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b7e55 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579571.068546:0:16124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffffa0ceba3c8600/0xb72beeaffa1b7e4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb72beeaffa1b7e55 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579571.068565:0:16124:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579571.068578:0:16124:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579571.068583:0:16124:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579571.068622:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6514e2d9-be54-4793-9feb-dcbd6b926656:3321:1874412616912640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787579571.068639:0:16619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f17800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16619:1874412616912000:0@lo:104: 00000100:00100000:2.0:1787579571.069409:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579571.069500:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787579571.069511:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6514e2d9-be54-4793-9feb-dcbd6b926656:3319:1874412616912512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787579571.069539:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579571.069654:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616912384 00000100:00100000:2.0:1787579571.069662:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616912384 00010000:00010000:2.0:1787579571.069696:0:14486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ceba3c9e00/0xb72beeaffa1b7fdd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b7fd6 expref: 19 pid: 14494 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579571.069724:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616912512 00000100:00100000:2.0:1787579571.069727:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616912512 00010000:00010000:2.0:1787579571.069737:0:14486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ce90a8b800/0xb72beeaffa1b7ea2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b7e9b expref: 20 pid: 14495 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579571.069751:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787579571.069759:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6514e2d9-be54-4793-9feb-dcbd6b926656+20:3319:x1874412616912384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787579571.069772:0:14486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579571.069778:0:14486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ceba3c9e00/0xb72beeaffa1b7fdd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b7fd6 expref: 20 pid: 14494 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579571.069788:0:14486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ceba3c9e00/0xb72beeaffa1b7fdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b7fd6 expref: 20 pid: 14494 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579571.069806:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ceba3c9e00/0xb72beeaffa1b7fdd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b7fd6 expref: 20 pid: 14494 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579571.069824:0:14486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579571.070962:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579571.071001:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579571.071063:0:14485:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787579571.071072:0:14485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1787579571.071109:0:14487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787579571.071434:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6514e2d9-be54-4793-9feb-dcbd6b926656+19:3319:x1874412616912384:12345-0@lo:103:ldlm_bl.0 Request processed in 1672us (2024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579571.071447:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787579571.071489:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591758208 00000100:00100000:2.0:1787579571.071498:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591758208 00010000:00010000:2.0:1787579571.071530:0:14486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ceba3c8200/0xb72beeaffa1b8134 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d377 expref: 13 pid: 14494 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579571.071553:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591758336 00000100:00100000:2.0:1787579571.071556:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591758336 00010000:00010000:2.0:1787579571.071572:0:14486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0cd8351f400/0xb72beeaffa1b80fc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d315 expref: 14 pid: 14494 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579571.071589:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787579571.071598:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec176bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6514e2d9-be54-4793-9feb-dcbd6b926656+18:3319:x1874412616912512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787579571.071610:0:14486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579571.071617:0:14486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ce90a8b800/0xb72beeaffa1b7ea2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b7e9b expref: 18 pid: 14495 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579571.071628:0:14486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ce90a8b800/0xb72beeaffa1b7ea2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b7e9b expref: 18 pid: 14495 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579571.071637:0:14487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1787579571.071650:0:14486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579571.071651:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:3.0:1787579571.071661:0:14487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf869050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+14:2359:x1874412591758208:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787579571.071672:0:14487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579571.071678:0:14487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ceba3c8200/0xb72beeaffa1b8134 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d377 expref: 14 pid: 14494 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579571.071689:0:14487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ceba3c8200/0xb72beeaffa1b8134 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d377 expref: 14 pid: 14494 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579571.071704:0:14487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787579571.071716:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579571.071767:0:14487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf869050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+14:2359:x1874412591758208:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 105us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579571.071776:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:2.0:1787579571.071783:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec176bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6514e2d9-be54-4793-9feb-dcbd6b926656+18:3319:x1874412616912512:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (2241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579571.071791:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787579571.072069:0:16619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce90a8b800/0xb72beeaffa1b7ea2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b7e9b expref: 17 pid: 14495 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579571.072086:0:16619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f15180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16619:1874412616912128:0@lo:104: 00000100:00100000:1.0:1787579571.072095:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6514e2d9-be54-4793-9feb-dcbd6b926656:3319:1874412616912512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787579571.072110:0:16619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f14000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16619:1874412616912256:0@lo:104: 00000100:00100000:1.0:1787579571.072135:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6514e2d9-be54-4793-9feb-dcbd6b926656:3319:1874412616912384:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787579571.072312:0:16619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ceba3c8200/0xb72beeaffa1b8134 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d377 expref: 13 pid: 14494 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579571.072329:0:16619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f15880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16619:1874412616911744:192.168.206.53@tcp:104: 00000100:00100000:0.0:1787579571.072340:0:16619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f14e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16619:1874412616911872:192.168.206.53@tcp:104: 00010000:00010000:0.0:1787579571.072373:0:16619:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0ceba3c8000/0xb72beeaffa1b815e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579571.072509:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616912640 00000100:00100000:3.0:1787579571.072533:0:14487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616912640 00000100:00100000:2.0:1787579571.072619:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:2.0:1787579571.072630:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8923bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+12:2360:x1874412591758336:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787579571.072639:0:14487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0ce90a8a800/0xb72beeaffa1b7e55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b7e4e expref: 17 pid: 14495 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579571.072642:0:14486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579571.072661:0:14486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0cd8351f400/0xb72beeaffa1b80fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d315 expref: 12 pid: 14494 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579571.072669:0:14487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1787579571.072675:0:14486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0cd8351f400/0xb72beeaffa1b80fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d315 expref: 12 pid: 14494 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579571.072683:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787579571.072692:0:14487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba316a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6514e2d9-be54-4793-9feb-dcbd6b926656+17:3321:x1874412616912640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787579571.072696:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0cd8351f400/0xb72beeaffa1b80fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d315 expref: 12 pid: 14494 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579571.072705:0:14487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579571.072709:0:14486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787579571.072712:0:14487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0ce90a8a800/0xb72beeaffa1b7e55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb72beeaffa1b7e4e expref: 17 pid: 14495 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579571.072724:0:14487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0ce90a8a800/0xb72beeaffa1b7e55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb72beeaffa1b7e4e expref: 17 pid: 14495 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579571.072735:0:14487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ce90a8a800/0xb72beeaffa1b7e55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb72beeaffa1b7e4e expref: 17 pid: 14495 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579571.072748:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8923bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+11:2360:x1874412591758336:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 119us (1745us total) trans 0 rc 0/0 00010000:00010000:3.0:1787579571.072751:0:14487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0ceba3c8000/0xb72beeaffa1b815e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579571.072759:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 7 00010000:00010000:3.0:1787579571.072764:0:14487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceba3c8000/0xb72beeaffa1b815e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579571.072781:0:14487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0ceba3c8000/0xb72beeaffa1b815e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579571.072788:0:14487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0ceba3c8000/0xb72beeaffa1b815e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579571.072795:0:14487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0ceba3c8000/0xb72beeaffa1b815e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579571.072802:0:14487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0ceba3c8000/0xb72beeaffa1b815e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579571.072816:0:14487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8000 already unused, calling callback (ffffffffc1654230) 00010000:00010000:3.0:1787579571.072821:0:14487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0ceba3c8000/0xb72beeaffa1b815e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579571.072830:0:14487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0ceba3c8000/0xb72beeaffa1b815e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579571.073037:0:16619:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0ceba3c8000/0xb72beeaffa1b815e lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579571.073045:0:16619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0ceba3c8000/0xb72beeaffa1b815e lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579571.074102:0:14487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0ceba3c8000/0xb72beeaffa1b815e lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579571.074130:0:14487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0ceba3c8000/0xb72beeaffa1b815e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579571.074158:0:14487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579571.074265:0:14487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba316a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6514e2d9-be54-4793-9feb-dcbd6b926656+16:3321:x1874412616912640:12345-0@lo:103:ldlm_bl.0 Request processed in 1570us (2554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579571.074275:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787579571.074910:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6514e2d9-be54-4793-9feb-dcbd6b926656:3321:1874412616912640:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787579571.111148:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579571.169545:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787579571.169580:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616912768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787579571.169665:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579571.169734:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616912768 00000100:00100000:1.0:1787579571.169743:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616912768 00000100:00100000:1.0:1787579571.169809:0:15189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787579571.169819:0:15189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616912768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787579571.169875:0:15189:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787579571.169962:0:15189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616912768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579571.169971:0:15189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1787579571.169998:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787579571.170042:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616912768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787579571.170238:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce8923a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874412616913024:0@lo:400:kworker.0 00000100:00100000:3.0:1787579571.170275:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579571.170303:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce8923ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616912896:0@lo:400:kworker.0 00000100:00100000:3.0:1787579571.170309:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616913024 00000100:00100000:3.0:1787579571.170313:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616913024 00000100:00100000:1.0:1787579571.170333:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579571.170344:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787579571.170350:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874412616913024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579571.170366:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce89239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616913152:0@lo:400:kworker.0 00000100:00100000:1.0:1787579571.170388:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579571.170389:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874412616913024:12345-0@lo:400:kworker.0 Request processed in 39us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579571.170395:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787579571.170407:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616913152 00000100:00100000:1.0:1787579571.170412:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787579571.170415:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616913152 00000100:00100000:1.0:1787579571.170417:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce89239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1874412616913280:0@lo:400:kworker.0 00000100:00100000:1.0:1787579571.170438:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579571.170443:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616913280 00000100:00100000:3.0:1787579571.170445:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616913280 00000100:00100000:1.0:1787579571.170461:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787579571.170571:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616912896 00000100:00100000:0.0:1787579571.170576:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616912896 00000100:00100000:0.0:1787579571.170611:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787579571.170617:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba315180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616912896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579571.170658:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba315180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616912896:12345-0@lo:400:kworker.0 Request processed in 41us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579571.170665:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787579571.170703:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616913152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579571.170740:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1874412616913152:12345-0@lo:400:kworker.0 Request processed in 273us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579571.175414:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787579571.175445:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874412616913280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579571.175566:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1874412616913280:12345-0@lo:400:kworker.0 Request processed in 136us (5125us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579571.175575:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787579571.175663:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce8923a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874412616913024:0@lo:400:kworker.0 00000100:00080000:3.0:1787579571.179363:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787579571.179375:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787579571.180325:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce8923ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616912896:0@lo:400:kworker.0 00000100:00100000:0.0:1787579571.182041:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce89239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3321:1874412616913280:0@lo:400:kworker.0 00000100:00100000:0.0:1787579571.182059:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce89239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3321:1874412616913152:0@lo:400:kworker.0 00000100:00100000:1.0:1787579571.184490:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1787579572.128798:0:16123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787579572.192232:0:14497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787579572.192239:0:14497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0cebf3ef800 from 10 10000000:01000000:1.0:1787579572.192244:0:14497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787579572.192286:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0cd8351f600/0xb72beeaffa1b8165 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579572.192298:0:14497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0cd8351f600/0xb72beeaffa1b8165 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579572.192309:0:14497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0cd8351f600/0xb72beeaffa1b8165 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579572.192334:0:14497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba316300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616913408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787579572.192400:0:14497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579572.192452:0:14497:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cd833f50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787579572.192514:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616913408 00000100:00100000:0.0:1787579572.192521:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616913408 00000100:00100000:0.0:1787579572.192569:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787579572.192579:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3d43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+16:14497:x1874412616913408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787579572.192591:0:14494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579572.192605:0:14494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceba3c8000/0xb72beeaffa1b816c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b8165 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579572.192626:0:14494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceba3c8000/0xb72beeaffa1b816c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b8165 expref: 17 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579572.192636:0:14494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceba3c8000/0xb72beeaffa1b816c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b8165 expref: 17 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579572.192643:0:14494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c8000, rc 0) 00000100:00100000:0.0:1787579572.192697:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3d43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6514e2d9-be54-4793-9feb-dcbd6b926656+17:14497:x1874412616913408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579572.192718:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787579572.192989:0:14497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba316300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616913408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787579572.193008:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0cd8351f600/0xb72beeaffa1b8165 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b816c expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579572.193018:0:14497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0cd8351f600/0xb72beeaffa1b8165 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b816c expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579572.193082:0:14497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1768700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616913536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787579572.193140:0:14497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579572.193172:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616913536 00000100:00100000:0.0:1787579572.193178:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616913536 00000100:00100000:2.0:1787579572.193180:0:14497:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84e28180 going to sleep for 11 seconds 00000100:00100000:0.0:1787579572.193216:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787579572.193224:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3d43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+17:14497:x1874412616913536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579572.193476:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3d43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+17:14497:x1874412616913536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579572.193483:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787579572.193515:0:14497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1768700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616913536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579572.193546:0:14497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce84f14e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616913664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787579572.193587:0:14497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579572.193600:0:14497:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9d11df00 going to sleep for 11 seconds 00000100:00100000:1.0:1787579572.193661:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616913664 00000100:00100000:1.0:1787579572.193666:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616913664 00000100:00100000:1.0:1787579572.193696:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787579572.193703:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb3d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+17:14497:x1874412616913664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787579572.193855:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb3d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+17:14497:x1874412616913664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579572.193872:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787579572.194885:0:14497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce84f14e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616913664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787579572.198909:0:16656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787579572.199191:0:14497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787579572.199223:0:14497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787579572.199234:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0cd8351f600/0xb72beeaffa1b8165 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b816c expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579572.199246:0:14497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0cd8351f600/0xb72beeaffa1b8165 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b816c expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579572.199255:0:14497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787579572.199258:0:14497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0ceb3e15000 from 10 10000000:01000000:1.0:1787579572.199261:0:14497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787579572.199298:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0cd8351f000/0xb72beeaffa1b8173 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579572.199307:0:14497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0cd8351f000/0xb72beeaffa1b8173 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579572.199317:0:14497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0cd8351f000/0xb72beeaffa1b8173 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579572.199340:0:14497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba314e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616913792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787579572.199416:0:14497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579572.199456:0:14497:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cd833f5000 going to sleep for 11 seconds 00000100:00100000:3.0:1787579572.200549:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616913792 00000100:00100000:3.0:1787579572.200559:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616913792 00000100:00100000:3.0:1787579572.200612:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787579572.200623:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce85115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+17:14497:x1874412616913792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787579572.200637:0:14492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579572.200664:0:14492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0cd82a01a00/0xb72beeaffa1b817a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b8173 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579572.200688:0:14492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0cd82a01a00/0xb72beeaffa1b817a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b8173 expref: 18 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579572.200698:0:14492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0cd82a01a00/0xb72beeaffa1b817a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b8173 expref: 18 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579572.200717:0:14492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0cd82a01a00, rc 0) 00000100:00100000:3.0:1787579572.200785:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce85115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+18:14497:x1874412616913792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579572.200791:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787579572.200883:0:14497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba314e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616913792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787579572.200899:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0cd8351f000/0xb72beeaffa1b8173 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b817a expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579572.200908:0:14497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0cd8351f000/0xb72beeaffa1b8173 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b817a expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579572.201009:0:14497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec176bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616913920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787579572.201039:0:14497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579572.201073:0:14497:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84e28300 going to sleep for 11 seconds 00000100:00100000:3.0:1787579572.201203:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616913920 00000100:00100000:3.0:1787579572.201208:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616913920 00000100:00100000:3.0:1787579572.201239:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787579572.201246:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce85114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+18:14497:x1874412616913920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787579572.201481:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce85114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+18:14497:x1874412616913920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 234us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579572.201488:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787579572.201558:0:14497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec176bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616913920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787579572.201586:0:14497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec176bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616914048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787579572.201623:0:14497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579572.201657:0:14497:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84e28300 going to sleep for 11 seconds 00000100:00100000:2.0:1787579572.201670:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616914048 00000100:00100000:2.0:1787579572.201674:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616914048 00000100:00100000:2.0:1787579572.201693:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787579572.201698:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce855bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+18:14497:x1874412616914048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787579572.201840:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce855bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+18:14497:x1874412616914048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579572.201847:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787579572.201882:0:14497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec176bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616914048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787579572.202510:0:16658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787579572.202575:0:14497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787579572.202595:0:14497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787579572.202604:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0cd8351f000/0xb72beeaffa1b8173 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b817a expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579572.202613:0:14497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0cd8351f000/0xb72beeaffa1b8173 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b817a expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579572.202622:0:14497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787579572.202625:0:14497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0ce91c07000 from 10 10000000:01000000:2.0:1787579572.202627:0:14497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787579572.202651:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba318800/0xb72beeaffa1b8181 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579572.202659:0:14497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffffa0ceba318800/0xb72beeaffa1b8181 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579572.202667:0:14497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffffa0ceba318800/0xb72beeaffa1b8181 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579572.202681:0:14497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec176bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616914176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787579572.202715:0:14497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579572.202744:0:14497:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84e28900 going to sleep for 11 seconds 00000100:00100000:2.0:1787579572.202759:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616914176 00000100:00100000:2.0:1787579572.202762:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616914176 00000100:00100000:2.0:1787579572.202784:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787579572.202790:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce855bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+18:14497:x1874412616914176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787579572.202800:0:14492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579572.202809:0:14492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0ceba318a00/0xb72beeaffa1b8188 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb72beeaffa1b8181 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579572.202839:0:14492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0ceba318a00/0xb72beeaffa1b8188 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb72beeaffa1b8181 expref: 19 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579572.202849:0:14492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0ceba318a00/0xb72beeaffa1b8188 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb72beeaffa1b8181 expref: 19 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579572.202858:0:14492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba318a00, rc 0) 00000100:00100000:2.0:1787579572.202890:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce855bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+19:14497:x1874412616914176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579572.202897:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787579572.202952:0:14497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec176bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616914176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787579572.202964:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffffa0ceba318800/0xb72beeaffa1b8181 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b8188 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579572.202973:0:14497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffffa0ceba318800/0xb72beeaffa1b8181 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb72beeaffa1b8188 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579572.203011:0:14497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec176bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616914304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787579572.203035:0:14497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579572.203055:0:14497:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84e28900 going to sleep for 11 seconds 00000100:00100000:2.0:1787579572.203066:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616914304 00000100:00100000:2.0:1787579572.203070:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616914304 00000100:00100000:2.0:1787579572.203084:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787579572.203089:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce855b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+19:14497:x1874412616914304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787579572.203303:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce855b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+19:14497:x1874412616914304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 212us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579572.203319:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787579572.203350:0:14497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec176bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616914304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787579572.203374:0:14497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec176bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616914432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787579572.203407:0:14497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579572.203422:0:14497:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84e28900 going to sleep for 11 seconds 00000100:00100000:2.0:1787579572.203433:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616914432 00000100:00100000:2.0:1787579572.203436:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616914432 00000100:00100000:2.0:1787579572.203452:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787579572.203457:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce88252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+19:14497:x1874412616914432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787579572.203574:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce88252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6514e2d9-be54-4793-9feb-dcbd6b926656+19:14497:x1874412616914432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579572.203581:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787579572.203613:0:14497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec176bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6514e2d9-be54-4793-9feb-dcbd6b926656:14497:1874412616914432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787579572.208990:0:16659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787579572.209053:0:14497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787579572.209075:0:14497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787579572.209086:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffffa0ceba318800/0xb72beeaffa1b8181 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b8188 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579572.209111:0:14497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffffa0ceba318800/0xb72beeaffa1b8181 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb72beeaffa1b8188 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579572.593528:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579572.593639:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591758464 00000100:00100000:3.0:1787579572.593649:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591758464 00000100:00100000:3.0:1787579572.595806:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 115 00000100:00100000:3.0:1787579572.595832:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce88250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+11:13796:x1874412591758464:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787579572.595850:0:14492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579572.595871:0:14492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0cd82a01e00/0xb72beeaffa1b818f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d3a8 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579572.595902:0:14492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0cd82a01e00/0xb72beeaffa1b818f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3a8 expref: 12 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579572.595913:0:14492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0cd82a01e00/0xb72beeaffa1b818f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3a8 expref: 12 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579572.595939:0:14492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0cd82a01e00, rc 0) 00000100:00100000:3.0:1787579572.596016:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce88250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+12:13796:x1874412591758464:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 Request processed in 196us (2496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579572.601618:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 115 00000100:00100000:3.0:1787579572.607441:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579572.610251:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591758592 00000100:00100000:1.0:1787579572.610266:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591758592 00000100:00100000:1.0:1787579572.610404:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 116 00000100:00100000:1.0:1787579572.610416:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce88253050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+12:13796:x1874412591758592:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787579572.610696:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce88253050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+12:13796:x1874412591758592:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 Request processed in 282us (3264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579572.610704:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 116 00000100:00100000:0.0:1787579572.617146:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579572.617252:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591758720 00000100:00100000:3.0:1787579572.617262:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591758720 00000100:00100000:3.0:1787579572.617363:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 117 00000100:00100000:3.0:1787579572.617374:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce88251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+12:13796:x1874412591758720:12345-192.168.206.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787579572.617595:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce88251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+12:13796:x1874412591758720:12345-192.168.206.53@tcp:503:ll_cfg_requeue.0 Request processed in 223us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579572.617604:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 117 00000100:00100000:0.0:1787579572.623360:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579572.623455:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591758848 00000100:00100000:1.0:1787579572.623465:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591758848 00000100:00100000:1.0:1787579572.623518:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 118 00000100:00100000:1.0:1787579572.623529:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce88250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+12:13796:x1874412591758848:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787579572.623544:0:14494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579572.623561:0:14494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0cd8351e400/0xb72beeaffa1b8196 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d3af expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579572.623589:0:14494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0cd8351e400/0xb72beeaffa1b8196 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3af expref: 13 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579572.623599:0:14494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0cd8351e400/0xb72beeaffa1b8196 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3af expref: 13 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579572.623608:0:14494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0cd8351e400, rc 0) 00000100:00100000:1.0:1787579572.623678:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce88250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+13:13796:x1874412591758848:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 Request processed in 151us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579572.623684:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 118 00000100:00100000:0.0:1787579572.626449:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579572.626548:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591758976 00000100:00100000:3.0:1787579572.626557:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591758976 00000100:00100000:3.0:1787579572.626648:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 119 00000100:00100000:3.0:1787579572.626658:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce88251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+13:13796:x1874412591758976:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787579572.627584:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce88251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+13:13796:x1874412591758976:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 Request processed in 923us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579572.627594:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 119 00000100:00100000:0.0:1787579572.630421:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579572.630515:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591759104 00000100:00100000:3.0:1787579572.630524:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591759104 00000100:00100000:3.0:1787579572.630609:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 120 00000100:00100000:3.0:1787579572.630619:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce88253c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+13:13796:x1874412591759104:12345-192.168.206.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787579572.630980:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce88253c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+13:13796:x1874412591759104:12345-192.168.206.53@tcp:503:ll_cfg_requeue.0 Request processed in 361us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579572.630988:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 120 00010000:00010000:2.0:1787579573.152999:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579573.955173:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579573.955320:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579573.955507:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591759360 00000100:00100000:3.0:1787579573.955521:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591759360 00000100:00100000:0.0:1787579573.955654:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579573.955680:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 27 00000100:00100000:0.0:1787579573.955693:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579573.955700:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+6:2360:x1874412591759360:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579573.955724:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579573.955751:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579573.955801:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579573.955810:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+6:2360:x1874412591759360:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 113us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579573.955821:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 27 00000100:00100000:3.0:1787579573.955838:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591759744 00000100:00100000:3.0:1787579573.955842:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591759744 00000100:00100000:0.0:1787579573.956010:0:15186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591759488 00000100:00100000:0.0:1787579573.956019:0:15186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591759488 00000100:00080000:1.0:1787579573.956200:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787579573.956207:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579573.956224:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591759616 00000100:00100000:1.0:1787579573.956230:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591759616 00000100:00100000:1.0:1787579573.956274:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591759872 00000100:00100000:1.0:1787579573.956285:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591759872 00000100:00100000:1.0:1787579573.956302:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591760000 00000100:00100000:1.0:1787579573.956305:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591760000 00000100:00100000:1.0:1787579573.956321:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:1.0:1787579573.956328:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+5:2360:x1874412591759616:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579573.956666:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+5:2360:x1874412591759616:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 337us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579573.956674:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:1.0:1787579573.956691:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:1.0:1787579573.956699:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+5:2360:x1874412591759872:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579573.956727:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+5:2360:x1874412591759872:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 30us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579573.956734:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:1.0:1787579573.956745:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:1.0:1787579573.956752:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+5:2359:x1874412591760000:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1787579573.956775:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+5:2359:x1874412591760000:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 23us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579573.956781:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00080000:1.0:1787579573.956808:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787579573.956811:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787579573.957748:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 28 00000100:00100000:3.0:1787579573.957758:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+6:2359:x1874412591759744:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1787579573.957809:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+6:2359:x1874412591759744:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 52us (2087us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579573.957816:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 28 00000100:00100000:2.0:1787579573.959703:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591759232 00000100:00100000:2.0:1787579573.959724:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591759232 00000100:00100000:2.0:1787579573.959797:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 121 00000100:00100000:2.0:1787579573.959809:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce88251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+13:2359:x1874412591759232:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1787579573.960094:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce88251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+13:2359:x1874412591759232:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 120us (4771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579573.960117:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 121 00000100:00100000:0.0:1787579573.962605:0:15186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 13 00000100:00100000:0.0:1787579573.962649:0:15186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+5:2359:x1874412591759488:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579573.962763:0:15186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+5:2359:x1874412591759488:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 123us (7111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579573.962771:0:15186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 13 00010000:00010000:1.0:1787579574.176859:0:16124:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579574.753134:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616914560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787579574.753229:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579574.753961:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616914560 00000100:00100000:1.0:1787579574.753974:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616914560 00000100:00100000:1.0:1787579574.754067:0:15189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787579574.754079:0:15189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec176bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616914560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787579574.754134:0:15189:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787579574.754211:0:15189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec176bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616914560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579574.754220:0:15189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1787579574.754342:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787579574.754511:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616914560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787579574.979256:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579574.979364:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591760128 00000100:00100000:0.0:1787579574.979383:0:16432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591760128 00000100:00100000:0.0:1787579574.979475:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 15 00000100:00100000:0.0:1787579574.979488:0:16432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8923a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+6:14455:x1874412591760128:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787579574.979513:0:16432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579574.979542:0:16432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b819d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d3b6 expref: -99 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579574.979622:0:16432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9800/0xb72beeaffa1b81a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579574.979639:0:16432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9800/0xb72beeaffa1b81a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579574.979656:0:16432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9800/0xb72beeaffa1b81a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579574.979672:0:16432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b81ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579574.979680:0:16432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b81ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579574.979687:0:16432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b81ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579574.980486:0:16432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b81b2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579574.980500:0:16432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b81b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579574.980510:0:16432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b81b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579574.980599:0:16432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787579574.980604:0:16432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787579574.980706:0:16432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b81b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579574.980720:0:16432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9800/0xb72beeaffa1b81a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579574.980727:0:16432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9800/0xb72beeaffa1b81a4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579574.980735:0:16432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9800/0xb72beeaffa1b81a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579574.980742:0:16432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579574.980746:0:16432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9800/0xb72beeaffa1b81a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579574.980755:0:16432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9800/0xb72beeaffa1b81a4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579574.980769:0:16432:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce96a86c00) 00010000:00010000:0.0:1787579574.980779:0:16432:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579574.980784:0:16432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9800/0xb72beeaffa1b81a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579574.980790:0:16432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9800/0xb72beeaffa1b81a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579574.980804:0:16432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b81ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579574.980809:0:16432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b81ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579574.980815:0:16432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b81ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579574.980819:0:16432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9a00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579574.980822:0:16432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b81ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579574.981166:0:16432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b81ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579574.981176:0:16432:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffffa0ce82cbb000) 00010000:00010000:0.0:1787579574.981179:0:16432:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579574.981182:0:16432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b81ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579574.981187:0:16432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b81ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579574.981238:0:16432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b819d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3b6 expref: 8 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579574.981268:0:16432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9400/0xb72beeaffa1b81b2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3b6 expref: 7 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579574.981276:0:16432:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0ce82cbb700) 00010000:00010000:0.0:1787579574.981279:0:16432:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787579574.981281:0:16432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c9400, rc 0) 00000100:00100000:0.0:1787579574.981382:0:16432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8923a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+7:14455:x1874412591760128:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 1896us (2133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579574.981391:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 15 00000100:00100000:1.0:1787579574.983786:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579574.983974:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591760384 00000100:00100000:3.0:1787579574.983988:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591760384 00000100:00100000:3.0:1787579574.984051:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00100000:3.0:1787579574.984063:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+7:14455:x1874412591760384:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787579574.984088:0:14502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579574.984240:0:14502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01c00/0xb72beeaffa1b81b9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d3bd expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579574.984335:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b81c0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579574.984351:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b81c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579574.984363:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b81c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579574.987712:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b81c7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579574.987735:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b81c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579574.987747:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b81c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579574.988394:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00000/0xb72beeaffa1b81ce lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579574.988406:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00000/0xb72beeaffa1b81ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579574.988414:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00000/0xb72beeaffa1b81ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579574.988426:0:14502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787579574.988758:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b81c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579574.988768:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b81c0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579574.988775:0:14502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b81c0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579574.988781:0:14502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd82a00800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579574.988786:0:14502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b81c0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579574.988805:0:14502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b81c0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579574.988819:0:14502:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0ce82cbb700) 00010000:00010000:3.0:1787579574.988822:0:14502:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579574.988827:0:14502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b81c0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579574.988834:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b81c0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579574.988853:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b81c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579574.988859:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b81c7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579574.988865:0:14502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b81c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579574.988870:0:14502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd82a01800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579574.988872:0:14502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b81c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579574.988879:0:14502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b81c7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579574.988886:0:14502:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffffa0ce96a86700) 00010000:00010000:3.0:1787579574.988889:0:14502:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579574.988892:0:14502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b81c7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579574.988907:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b81c7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579574.989392:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01c00/0xb72beeaffa1b81b9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3bd expref: 10 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579574.989410:0:14502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00000/0xb72beeaffa1b81ce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3bd expref: 9 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579574.989417:0:14502:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0ce96a86f00) 00010000:00010000:3.0:1787579574.989420:0:14502:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579574.989422:0:14502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0cd82a00000, rc 0) 00000100:00100000:3.0:1787579574.989607:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+9:14455:x1874412591760384:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 5545us (5834us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787579574.989616:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00100000:3.0:1787579574.992714:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579574.992824:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591760512 00000100:00100000:1.0:1787579574.992839:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591760512 00000100:00100000:1.0:1787579574.992913:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 17 00000100:00100000:1.0:1787579574.992950:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8923a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+9:14455:x1874412591760512:12345-192.168.206.53@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787579574.993072:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8923a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+9:14455:x1874412591760512:12345-192.168.206.53@tcp:59:lhsmtool_posix.0 Request processed in 149us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579574.993079:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 17 00000100:00100000:0.0:1787579575.066481:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579575.066589:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591760640 00000100:00100000:1.0:1787579575.066599:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591760640 00000100:00100000:1.0:1787579575.066671:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 18 00000100:00100000:1.0:1787579575.066683:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+9:14461:x1874412591760640:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1787579575.066703:0:14501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579575.066724:0:14501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fe00/0xb72beeaffa1b81dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d3c4 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.066822:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fc00/0xb72beeaffa1b81e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.066837:0:14501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fc00/0xb72beeaffa1b81e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.066848:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fc00/0xb72beeaffa1b81e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.066863:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b81ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.066870:0:14501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b81ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.066877:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b81ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787579575.067056:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787579575.067658:0:14501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fc00/0xb72beeaffa1b81e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.067668:0:14501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fc00/0xb72beeaffa1b81e3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.067674:0:14501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fc00/0xb72beeaffa1b81e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.067679:0:14501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd8351fc00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579575.067684:0:14501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fc00/0xb72beeaffa1b81e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.067703:0:14501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fc00/0xb72beeaffa1b81e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.067719:0:14501:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce96a86c00) 00010000:00010000:1.0:1787579575.067722:0:14501:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579575.067727:0:14501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fc00/0xb72beeaffa1b81e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.067733:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fc00/0xb72beeaffa1b81e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.067746:0:14501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b81ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.067753:0:14501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b81ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.067759:0:14501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b81ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.067764:0:14501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd8351f800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579575.067767:0:14501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b81ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.067773:0:14501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b81ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.067781:0:14501:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa0ce974ae100) 00010000:00010000:1.0:1787579575.067783:0:14501:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579575.067786:0:14501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b81ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.067804:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b81ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.067854:0:14501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fe00/0xb72beeaffa1b81dc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3c4 expref: 10 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.067864:0:14501:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce96a86c00) 00010000:00010000:1.0:1787579575.067866:0:14501:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579575.067870:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fe00/0xb72beeaffa1b81dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3c4 expref: 10 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.067890:0:14501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0cd8351fe00, rc 0) 00000100:00100000:1.0:1787579575.075280:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+9:14461:x1874412591760640:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 8589us (8796us total) trans 0 rc 301/301 00000100:00100000:1.0:1787579575.075292:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 18 00000100:00100000:1.0:1787579575.084043:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579575.084171:0:14509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591760768 00000100:00100000:0.0:1787579575.084180:0:14509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591760768 00000100:00100000:0.0:1787579575.084228:0:14509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:0.0:1787579575.084239:0:14509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+9:14461:x1874412591760768:12345-192.168.206.53@tcp:700:lfs.0 00000100:00100000:0.0:1787579575.084325:0:14509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+9:14461:x1874412591760768:12345-192.168.206.53@tcp:700:lfs.0 Request processed in 87us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579575.084333:0:14509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:3.0:1787579575.086188:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579575.088613:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591761024 00000100:00100000:1.0:1787579575.088629:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591761024 00000100:00100000:1.0:1787579575.088695:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 19 00000100:00100000:1.0:1787579575.088708:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+9:14461:x1874412591761024:12345-192.168.206.53@tcp:36:lfs.0 00010000:00010000:1.0:1787579575.088763:0:14500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787579575.088792:0:14500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00e00/0xb72beeaffa1b811f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d33f expref: 9 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.088916:0:14500:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce96a86c00) 00010000:00010000:1.0:1787579575.088922:0:14500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787579575.089648:0:14500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b81f1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.089667:0:14500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b8157 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3a1 expref: 5 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.089676:0:14500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b81f1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.089709:0:14500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b8157 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3a1 expref: 5 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.089724:0:14500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b8157 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3a1 expref: 5 pid: 14501 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579575.089737:0:14500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba317b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14500:1874412616914688:192.168.206.53@tcp:104: 00000100:00100000:1.0:1787579575.091554:0:14500:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce97446840 going to sleep for 11 seconds 00000100:00100000:2.0:1787579575.104912:0:14500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba317b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14500:1874412616914688:192.168.206.53@tcp:104: 00010000:00010000:2.0:1787579575.104964:0:14500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b81f1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579575.105578:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579575.111346:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591761152 00000100:00100000:2.0:1787579575.111362:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591761152 00010000:00010000:2.0:1787579575.111493:0:14486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b8157 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3a1 expref: 6 pid: 14501 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579575.111536:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00100000:2.0:1787579575.111546:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89239c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+6:2359:x1874412591761152:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787579575.111560:0:14486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579575.111567:0:14486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b8157 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3a1 expref: 6 pid: 14501 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579575.111581:0:14486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b8157 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3a1 expref: 6 pid: 14501 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579575.111605:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b8157 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3a1 expref: 6 pid: 14501 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579575.111622:0:14486:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce96a86c00) 00010000:00010000:2.0:1787579575.111627:0:14486:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b81f1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579575.111648:0:14486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b81f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579575.111656:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b81f1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579575.111689:0:14486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579575.111745:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89239c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+5:2359:x1874412591761152:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 200us (6170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579575.111753:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 9 00010000:00010000:0.0:1787579575.112643:0:14500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b81f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579575.112655:0:14500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b81f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579575.112679:0:14500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b81f8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579575.112690:0:14500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b81f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579575.112708:0:14500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b81f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579575.113912:0:14500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787579575.113947:0:14500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b81f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579575.113956:0:14500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b81f1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579575.113963:0:14500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b81f1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579575.113968:0:14500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd8351f800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579575.113973:0:14500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b81f1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579575.113980:0:14500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b81f1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579575.113994:0:14500:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce96a86c00) 00010000:00010000:0.0:1787579575.113996:0:14500:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579575.114001:0:14500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b81f1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579575.114007:0:14500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b81f1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787579575.114024:0:14500:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003bdcb149 reply state 00000000bb4b55a6 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b81f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579575.114047:0:14500:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787579575.114154:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+10:14461:x1874412591761024:12345-192.168.206.53@tcp:36:lfs.0 Request processed in 25446us (27969us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787579575.114163:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 19 00010000:00010000:0.0:1787579575.118851:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b81f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579575.118878:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b81f8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579575.118886:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b81f8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579575.118892:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579575.118897:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b81f8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579575.118905:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b81f8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579575.118921:0:3305:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa0ce82cbb000) 00010000:00010000:0.0:1787579575.118947:0:3305:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787579575.118953:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b81f8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579575.118959:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b81f8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787579575.120407:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787579575.200176:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579575.231979:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579575.232211:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591761280 00000100:00100000:3.0:1787579575.232221:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591761280 00000100:00100000:3.0:1787579575.232293:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 20 00000100:00100000:3.0:1787579575.232305:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+9:14469:x1874412591761280:12345-192.168.206.53@tcp:101:lctl.0 00010000:00010000:3.0:1787579575.232327:0:14502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579575.232351:0:14502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01400/0xb72beeaffa1b81ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d3cb expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.232435:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01c00/0xb72beeaffa1b8206 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.232450:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01c00/0xb72beeaffa1b8206 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.232460:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01c00/0xb72beeaffa1b8206 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579575.232516:0:14502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787579575.232521:0:14502:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787579575.232560:0:14502:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01c00/0xb72beeaffa1b8206 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.232587:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01400/0xb72beeaffa1b81ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3cb expref: 11 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.232606:0:14502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01c00/0xb72beeaffa1b8206 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3cb expref: 10 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.232614:0:14502:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce96a86700) 00010000:00010000:3.0:1787579575.232617:0:14502:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787579575.232620:0:14502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0cd82a01c00, rc 0) 00000100:00100000:3.0:1787579575.232677:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+10:14469:x1874412591761280:12345-192.168.206.53@tcp:101:lctl.0 Request processed in 375us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579575.232685:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 20 00000100:00100000:3.0:1787579575.279179:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579575.281800:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591761408 00000100:00100000:1.0:1787579575.281813:0:16432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591761408 00000100:00100000:1.0:1787579575.281884:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 21 00000100:00100000:1.0:1787579575.281894:0:16432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+5:14470:x1874412591761408:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1787579575.281911:0:16432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579575.281946:0:16432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fc00/0xb72beeaffa1b820d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d3d2 expref: -99 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.282005:0:16432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ec00/0xb72beeaffa1b8214 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.282018:0:16432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ec00/0xb72beeaffa1b8214 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.282043:0:16432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ec00/0xb72beeaffa1b8214 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787579575.282120:0:16432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787579575.282123:0:16432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787579575.282147:0:16432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ec00/0xb72beeaffa1b8214 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.282172:0:16432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fc00/0xb72beeaffa1b820d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3d2 expref: 7 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.282188:0:16432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ec00/0xb72beeaffa1b8214 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3d2 expref: 6 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.282196:0:16432:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce96a86700) 00010000:00010000:1.0:1787579575.282199:0:16432:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787579575.282203:0:16432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0cd8351ec00, rc 0) 00000100:00100000:1.0:1787579575.282270:0:16432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+6:14470:x1874412591761408:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 378us (3101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579575.282278:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 21 00000100:00100000:2.0:1787579575.288165:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579575.288228:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591761536 00000100:00100000:3.0:1787579575.288259:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591761536 00000100:00100000:3.0:1787579575.288317:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 22 00000100:00100000:3.0:1787579575.288326:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec176a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+6:14470:x1874412591761536:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1787579575.288345:0:14502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579575.288365:0:14502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01400/0xb72beeaffa1b821b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d3d9 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.288422:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8222 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.288435:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8222 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.288446:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8222 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.288460:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b8229 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.288467:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b8229 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.288473:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b8229 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.288626:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00c00/0xb72beeaffa1b8230 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.288635:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00c00/0xb72beeaffa1b8230 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.288642:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00c00/0xb72beeaffa1b8230 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579575.288687:0:14502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787579575.288691:0:14502:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787579575.288726:0:14502:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00c00/0xb72beeaffa1b8230 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.288746:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8222 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.288754:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8222 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.288767:0:14502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8222 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.288773:0:14502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd82a01800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579575.288778:0:14502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8222 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.288786:0:14502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8222 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.288798:0:14502:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce96a86700) 00010000:00010000:3.0:1787579575.288801:0:14502:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579575.288818:0:14502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8222 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.288825:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8222 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.288838:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b8229 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.288855:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b8229 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.288862:0:14502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b8229 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.289011:0:14502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd82a00800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579575.289016:0:14502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b8229 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.289022:0:14502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b8229 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.289041:0:14502:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa0ce96a86100) 00010000:00010000:3.0:1787579575.289044:0:14502:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579575.289047:0:14502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b8229 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.289053:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b8229 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.289090:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01400/0xb72beeaffa1b821b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3d9 expref: 8 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.289116:0:14502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00c00/0xb72beeaffa1b8230 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3d9 expref: 7 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.289123:0:14502:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0ce96a86500) 00010000:00010000:3.0:1787579575.289125:0:14502:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787579575.289142:0:14502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0cd82a00c00, rc 0) 00000100:00100000:3.0:1787579575.289201:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec176a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+7:14470:x1874412591761536:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 875us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579575.289209:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 22 00000100:00100000:2.0:1787579575.292864:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579575.292962:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591761792 00000100:00100000:1.0:1787579575.292972:0:16432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591761792 00000100:00100000:1.0:1787579575.293034:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 23 00000100:00100000:1.0:1787579575.293045:0:16432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+7:14470:x1874412591761792:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1787579575.293065:0:16432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579575.293085:0:16432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fc00/0xb72beeaffa1b8237 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d3e0 expref: -99 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787579575.293231:0:16432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787579575.293346:0:16432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fc00/0xb72beeaffa1b8237 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3e0 expref: 9 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.293360:0:16432:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce96a86700) 00010000:00010000:1.0:1787579575.293363:0:16432:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787579575.293368:0:16432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fc00/0xb72beeaffa1b8237 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3e0 expref: 9 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.293381:0:16432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0cd8351fc00, rc 0) 00000100:00100000:1.0:1787579575.293443:0:16432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+8:14470:x1874412591761792:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 399us (588us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1787579575.293451:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 23 00000100:00100000:1.0:1787579575.297198:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579575.297273:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591762048 00000100:00100000:3.0:1787579575.297282:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591762048 00000100:00100000:3.0:1787579575.297336:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 24 00000100:00100000:3.0:1787579575.297346:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+8:14470:x1874412591762048:12345-192.168.206.53@tcp:36:lfs.0 00010000:00010000:3.0:1787579575.297397:0:14501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579575.297421:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00c00/0xb72beeaffa1b8230 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3d9 expref: 8 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.297444:0:14501:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0ce96a86500) 00010000:00010000:3.0:1787579575.297454:0:14501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787579575.297476:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01400/0xb72beeaffa1b8245 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.297488:0:14501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01400/0xb72beeaffa1b8245 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.297500:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01400/0xb72beeaffa1b8245 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787579575.297700:0:14501:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000144c0f9a reply state 0000000033debd5b transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01400/0xb72beeaffa1b8245 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579575.297710:0:14501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787579575.297722:0:14501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1787579575.297793:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+9:14470:x1874412591762048:12345-192.168.206.53@tcp:36:lfs.0 Request processed in 448us (603us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787579575.297815:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 24 00000100:00100000:2.0:1787579575.300655:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00010000:00010000:1.0:1787579575.300759:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01400/0xb72beeaffa1b8245 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.300771:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01400/0xb72beeaffa1b8245 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.300778:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01400/0xb72beeaffa1b8245 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.300784:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd82a01400 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579575.300789:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01400/0xb72beeaffa1b8245 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.300796:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01400/0xb72beeaffa1b8245 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.300824:0:3306:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0ce96a86100) 00010000:00010000:1.0:1787579575.300827:0:3306:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1787579575.300830:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01400/0xb72beeaffa1b8245 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.300836:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01400/0xb72beeaffa1b8245 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579575.301170:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591762304 00000100:00100000:3.0:1787579575.301181:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591762304 00000100:00100000:3.0:1787579575.301225:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 2 00000100:00100000:3.0:1787579575.301234:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec176a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+8:14470:x1874412591762304:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:3.0:1787579575.301475:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec176a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+9:14470:x1874412591762304:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 241us (827us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787579575.301482:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 2 00000100:00100000:0.0:1787579575.305431:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579575.305504:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591762560 00000100:00100000:1.0:1787579575.305514:0:16432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591762560 00000100:00100000:1.0:1787579575.305566:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 25 00000100:00100000:1.0:1787579575.305576:0:16432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce84f14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+9:14470:x1874412591762560:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1787579575.305600:0:16432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579575.305618:0:16432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fc00/0xb72beeaffa1b824c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d3e7 expref: -99 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.305685:0:16432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351e200/0xb72beeaffa1b8253 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.305699:0:16432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351e200/0xb72beeaffa1b8253 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.305709:0:16432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351e200/0xb72beeaffa1b8253 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.305722:0:16432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b825a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.305729:0:16432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b825a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.305751:0:16432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b825a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787579575.306001:0:16432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787579575.306172:0:16432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351e200/0xb72beeaffa1b8253 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.306180:0:16432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351e200/0xb72beeaffa1b8253 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.306187:0:16432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351e200/0xb72beeaffa1b8253 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.306193:0:16432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd8351e200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579575.306197:0:16432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351e200/0xb72beeaffa1b8253 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.306204:0:16432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351e200/0xb72beeaffa1b8253 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.306216:0:16432:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce96a86700) 00010000:00010000:1.0:1787579575.306219:0:16432:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579575.306223:0:16432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351e200/0xb72beeaffa1b8253 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.306229:0:16432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351e200/0xb72beeaffa1b8253 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.306240:0:16432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b825a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.306259:0:16432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b825a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.306265:0:16432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b825a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.306269:0:16432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd8351ea00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579575.306272:0:16432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b825a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.306278:0:16432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b825a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.306285:0:16432:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa0ce974ae100) 00010000:00010000:1.0:1787579575.306288:0:16432:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579575.306291:0:16432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b825a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.306296:0:16432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b825a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.306334:0:16432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fc00/0xb72beeaffa1b824c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3e7 expref: 11 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.306344:0:16432:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce96a86700) 00010000:00010000:1.0:1787579575.306346:0:16432:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787579575.306351:0:16432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fc00/0xb72beeaffa1b824c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3e7 expref: 11 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.306371:0:16432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0cd8351fc00, rc 0) 00000100:00100000:1.0:1787579575.306424:0:16432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce84f14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+10:14470:x1874412591762560:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 849us (1001us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1787579575.306431:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 25 00000100:00100000:0.0:1787579575.313399:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579575.313505:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591762688 00000100:00100000:3.0:1787579575.313514:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591762688 00000100:00100000:3.0:1787579575.313568:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 26 00000100:00100000:3.0:1787579575.313579:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb468aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+10:14470:x1874412591762688:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1787579575.313600:0:14501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579575.313622:0:14501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00c00/0xb72beeaffa1b8268 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d3ee expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.313706:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b826f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.313718:0:14501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b826f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.313728:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b826f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579575.313776:0:14501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787579575.313779:0:14501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787579575.313813:0:14501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b826f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.313839:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00c00/0xb72beeaffa1b8268 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3ee expref: 12 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.313861:0:14501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b826f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3ee expref: 11 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.313879:0:14501:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0ce96a86500) 00010000:00010000:3.0:1787579575.313882:0:14501:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787579575.313886:0:14501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0cd82a00800, rc 0) 00000100:00100000:3.0:1787579575.314054:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb468aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+11:14470:x1874412591762688:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 476us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579575.314060:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 26 00000100:00100000:2.0:1787579575.318373:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579575.318454:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591762816 00000100:00100000:3.0:1787579575.318464:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591762816 00000100:00100000:3.0:1787579575.318517:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 3 00000100:00100000:3.0:1787579575.318528:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+11:14470:x1874412591762816:12345-192.168.206.53@tcp:37:lfs.0 00000100:00100000:3.0:1787579575.327001:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+11:14470:x1874412591762816:12345-192.168.206.53@tcp:37:lfs.0 Request processed in 8466us (8627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579575.327014:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 3 00000100:00100000:0.0:1787579575.331163:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579575.331255:0:14504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591763072 00000100:00100000:1.0:1787579575.331264:0:14504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591763072 00000100:00100000:1.0:1787579575.331317:0:14504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 4 00000100:00100000:1.0:1787579575.331328:0:14504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa28450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+11:14470:x1874412591763072:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:1.0:1787579575.331572:0:14504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa28450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+12:14470:x1874412591763072:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 244us (416us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787579575.331580:0:14504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 4 00000100:00100000:2.0:1787579575.411859:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579575.412006:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591763200 00000100:00100000:1.0:1787579575.412015:0:16432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591763200 00000100:00100000:1.0:1787579575.412080:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 27 00000100:00100000:1.0:1787579575.412090:0:16432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec176b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+10:14476:x1874412591763200:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:1.0:1787579575.412118:0:16432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579575.412137:0:16432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fc00/0xb72beeaffa1b8276 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d3f5 expref: -99 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.412199:0:16432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b827d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.412214:0:16432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b827d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.412224:0:16432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b827d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.412251:0:16432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351e200/0xb72beeaffa1b8284 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.412259:0:16432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351e200/0xb72beeaffa1b8284 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.412266:0:16432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351e200/0xb72beeaffa1b8284 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.412367:0:16432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b828b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.412375:0:16432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b828b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.412382:0:16432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b828b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787579575.412409:0:16432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787579575.412412:0:16432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787579575.412450:0:16432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b828b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.412462:0:16432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b827d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.412468:0:16432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b827d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.412475:0:16432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b827d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.412489:0:16432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd8351ea00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579575.412493:0:16432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b827d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.412501:0:16432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b827d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.412513:0:16432:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce96a86700) 00010000:00010000:1.0:1787579575.412516:0:16432:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579575.412520:0:16432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b827d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.412526:0:16432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b827d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.412538:0:16432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351e200/0xb72beeaffa1b8284 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.412544:0:16432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351e200/0xb72beeaffa1b8284 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.412550:0:16432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351e200/0xb72beeaffa1b8284 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.412555:0:16432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd8351e200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579575.412558:0:16432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351e200/0xb72beeaffa1b8284 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.412564:0:16432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351e200/0xb72beeaffa1b8284 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.412581:0:16432:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa0ce974ae100) 00010000:00010000:1.0:1787579575.412584:0:16432:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579575.412587:0:16432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351e200/0xb72beeaffa1b8284 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.412593:0:16432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351e200/0xb72beeaffa1b8284 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.412621:0:16432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fc00/0xb72beeaffa1b8276 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3f5 expref: 12 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.412635:0:16432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f800/0xb72beeaffa1b828b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3f5 expref: 11 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.412642:0:16432:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0ce96a86500) 00010000:00010000:1.0:1787579575.412644:0:16432:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787579575.412646:0:16432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0cd8351f800, rc 0) 00000100:00100000:1.0:1787579575.412708:0:16432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec176b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+11:14476:x1874412591763200:12345-192.168.206.53@tcp:101:bash.0 Request processed in 620us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579575.412715:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 27 00000100:00100000:0.0:1787579575.419723:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579575.419808:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591763456 00000100:00100000:3.0:1787579575.419818:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591763456 00000100:00100000:3.0:1787579575.419882:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 28 00000100:00100000:3.0:1787579575.419893:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+11:14476:x1874412591763456:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:3.0:1787579575.419911:0:14501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579575.419963:0:14501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00c00/0xb72beeaffa1b8292 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d3fc expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.420093:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8299 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.420119:0:14501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b826f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3ee expref: 11 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.420127:0:14501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8299 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.420159:0:14501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b826f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3ee expref: 11 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.420173:0:14501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b826f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3ee expref: 11 pid: 14501 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579575.420186:0:14501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce8923b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14501:1874412616914816:192.168.206.53@tcp:104: 00000100:00100000:3.0:1787579575.420325:0:14501:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9746a780 going to sleep for 11 seconds 00000100:00100000:2.0:1787579575.425358:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579575.425441:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591763584 00000100:00100000:0.0:1787579575.425450:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591763584 00010000:00010000:0.0:1787579575.425489:0:14485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b826f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3ee expref: 12 pid: 14501 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579575.425532:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:0.0:1787579575.425542:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+12:2360:x1874412591763584:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579575.425557:0:14485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579575.425564:0:14485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b826f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3ee expref: 12 pid: 14501 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579575.425577:0:14485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b826f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3ee expref: 12 pid: 14501 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579575.425599:0:14485:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0ce96a86500) 00010000:00010000:0.0:1787579575.425604:0:14485:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8299 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579575.425614:0:14485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8299 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579575.425622:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8299 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579575.425640:0:14485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579575.425693:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+12:2360:x1874412591763584:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 152us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579575.425717:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 10 00010000:00010000:3.0:1787579575.427118:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b826f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3ee expref: 11 pid: 14501 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579575.427146:0:14501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce8923b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14501:1874412616914816:192.168.206.53@tcp:104: 00010000:00010000:3.0:1787579575.427167:0:14501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8299 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.427177:0:14501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8299 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.427200:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8299 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.427223:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b82a0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.427235:0:14501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b82a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.427246:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b82a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.428414:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00400/0xb72beeaffa1b82a7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.428429:0:14501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00400/0xb72beeaffa1b82a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.428439:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00400/0xb72beeaffa1b82a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579575.428452:0:14501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787579575.428478:0:14501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8299 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.428486:0:14501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8299 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.428494:0:14501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8299 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.428500:0:14501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd82a01800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579575.428512:0:14501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8299 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.428520:0:14501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8299 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.428532:0:14501:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0ce96a86500) 00010000:00010000:3.0:1787579575.428536:0:14501:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579575.428540:0:14501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8299 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.428547:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8299 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787579575.428560:0:14501:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be2f0ecc reply state 00000000707130ad transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b82a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579575.428568:0:14501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787579575.428600:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00c00/0xb72beeaffa1b8292 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3fc expref: 14 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.428620:0:14501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00400/0xb72beeaffa1b82a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3fc expref: 13 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.428628:0:14501:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0ce96a86200) 00010000:00010000:3.0:1787579575.428631:0:14501:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1787579575.428633:0:14501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0cd82a00400, rc 0) 00000100:00100000:3.0:1787579575.428705:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+14:14476:x1874412591763456:12345-192.168.206.53@tcp:101:bash.0 Request processed in 8814us (8990us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787579575.428713:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 28 00010000:00010000:3.0:1787579575.432399:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b82a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.432416:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b82a0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.432424:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b82a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.432430:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd82a00200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579575.432435:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b82a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.432442:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b82a0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.432458:0:3305:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffffa0ce96a86400) 00010000:00010000:3.0:1787579575.432461:0:3305:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579575.432466:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b82a0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.432472:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b82a0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579575.441182:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579575.441274:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591763712 00000100:00100000:1.0:1787579575.441284:0:16432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591763712 00000100:00100000:1.0:1787579575.441339:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 29 00000100:00100000:1.0:1787579575.441348:0:16432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec176b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+13:14476:x1874412591763712:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:1.0:1787579575.441370:0:16432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579575.441389:0:16432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b82b5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d403 expref: -99 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.441462:0:16432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fe00/0xb72beeaffa1b82bc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.441475:0:16432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fe00/0xb72beeaffa1b82bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.441485:0:16432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fe00/0xb72beeaffa1b82bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787579575.441518:0:16432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787579575.441521:0:16432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787579575.441535:0:16432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fe00/0xb72beeaffa1b82bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.441545:0:16432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fe00/0xb72beeaffa1b82bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.441566:0:16432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b82b5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d403 expref: 15 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.441583:0:16432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fe00/0xb72beeaffa1b82bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d403 expref: 14 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.441592:0:16432:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0ce96a86200) 00010000:00010000:1.0:1787579575.441595:0:16432:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787579575.441598:0:16432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0cd8351fe00, rc 0) 00000100:00100000:1.0:1787579575.441656:0:16432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec176b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+14:14476:x1874412591763712:12345-192.168.206.53@tcp:101:bash.0 Request processed in 308us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579575.441663:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 29 00000100:00100000:2.0:1787579575.447785:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579575.447878:0:14504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591763968 00000100:00100000:1.0:1787579575.447888:0:14504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591763968 00000100:00100000:1.0:1787579575.447958:0:14504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:1.0:1787579575.447968:0:14504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+14:14476:x1874412591763968:12345-192.168.206.53@tcp:35:bash.0 00000100:00100000:1.0:1787579575.448310:0:14504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+15:14476:x1874412591763968:12345-192.168.206.53@tcp:35:bash.0 Request processed in 342us (533us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787579575.448318:0:14504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:2.0:1787579575.524863:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579575.525002:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591764224 00000100:00100000:3.0:1787579575.525012:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591764224 00000100:00100000:3.0:1787579575.525079:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 30 00000100:00100000:3.0:1787579575.525089:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec176aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+15:14486:x1874412591764224:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1787579575.525119:0:14502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579575.525138:0:14502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b82c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d40a expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579575.525275:0:14502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787579575.525386:0:14502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b82c3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d40a expref: 17 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.525400:0:14502:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ce96a86700) 00010000:00010000:3.0:1787579575.525403:0:14502:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787579575.525408:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b82c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d40a expref: 17 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.525426:0:14502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0cd82a00200, rc 0) 00000100:00100000:3.0:1787579575.525488:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec176aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+16:14486:x1874412591764224:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 400us (634us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1787579575.525495:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 30 00000100:00100000:2.0:1787579575.534166:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579575.534269:0:14504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591764480 00000100:00100000:1.0:1787579575.534277:0:14504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591764480 00000100:00100000:1.0:1787579575.534329:0:14504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:1.0:1787579575.534338:0:14504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+16:14486:x1874412591764480:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:1.0:1787579575.534563:0:14504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+17:14486:x1874412591764480:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 226us (406us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787579575.534579:0:14504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:2.0:1787579575.584762:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579575.584862:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591764736 00000100:00100000:1.0:1787579575.585021:0:16432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591764736 00000100:00100000:1.0:1787579575.585089:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 31 00000100:00100000:1.0:1787579575.585108:0:16432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+17:14489:x1874412591764736:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1787579575.585252:0:16432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579575.585273:0:16432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b82d1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d411 expref: -99 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.585364:0:16432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351e800/0xb72beeaffa1b82d8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.585376:0:16432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351e800/0xb72beeaffa1b82d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.585402:0:16432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351e800/0xb72beeaffa1b82d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787579575.585414:0:16432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787579575.585527:0:16432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351ea00/0xb72beeaffa1b82d1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d411 expref: 20 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.585545:0:16432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351e800/0xb72beeaffa1b82d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d411 expref: 19 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579575.585554:0:16432:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0ce96a86200) 00010000:00010000:1.0:1787579575.585557:0:16432:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787579575.585560:0:16432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0cd8351e800, rc 0) 00000100:00100000:1.0:1787579575.585657:0:16432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+19:14489:x1874412591764736:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 558us (903us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787579575.585665:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 31 00000100:00100000:2.0:1787579575.592480:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579575.592567:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579575.592643:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591764992 00000100:00100000:0.0:1787579575.592652:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591764992 00000100:00100000:0.0:1787579575.592716:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:0.0:1787579575.592726:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec176a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+19:2362:x1874412591764992:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579575.592741:0:14486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579575.592764:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351e800/0xb72beeaffa1b82d8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d411 expref: 19 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579575.592782:0:14486:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0ce96a86200) 00010000:00010000:0.0:1787579575.592786:0:14486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579575.592888:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec176a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+18:2362:x1874412591764992:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 162us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579575.592896:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:3.0:1787579575.593247:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591764864 00000100:00100000:3.0:1787579575.593254:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591764864 00000100:00100000:3.0:1787579575.593292:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 32 00000100:00100000:3.0:1787579575.593300:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec176ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+18:14489:x1874412591764864:12345-192.168.206.53@tcp:54:lfs.0 00010000:00010000:3.0:1787579575.593352:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b82e6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.593365:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b82e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.593375:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b82e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.593397:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b82e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.593416:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b82e6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.593423:0:14502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b82e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.593428:0:14502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd82a00200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579575.593432:0:14502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b82e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.593440:0:14502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b82e6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.593449:0:14502:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0ce96a86200) 00010000:00010000:3.0:1787579575.593452:0:14502:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787579575.593455:0:14502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b82e6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579575.593460:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b82e6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579575.593505:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec176ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+18:14489:x1874412591764864:12345-192.168.206.53@tcp:54:lfs.0 Request processed in 206us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579575.593512:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 32 00000100:00100000:2.0:1787579575.596649:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579575.596731:0:14504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591765248 00000100:00100000:1.0:1787579575.596740:0:14504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591765248 00000100:00100000:1.0:1787579575.596822:0:14504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:1.0:1787579575.596833:0:14504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+18:14489:x1874412591765248:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:1.0:1787579575.597297:0:14504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+19:14489:x1874412591765248:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 465us (656us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787579575.597306:0:14504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 7 00000040:00080000:3.0:1787579575.904852:0:14534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787579575.953616:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579575.953728:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591765504 00000100:00100000:0.0:1787579575.953737:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591765504 00000100:00100000:0.0:1787579575.953829:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 33 00000100:00100000:0.0:1787579575.953840:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+19:14520:x1874412591765504:12345-192.168.206.53@tcp:101:cat.0 00010000:00010000:0.0:1787579575.953862:0:14500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579575.953890:0:14500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b82ed lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d418 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579575.954004:0:14500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b82f4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579575.954018:0:14500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b82f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579575.954055:0:14500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b82f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579575.954067:0:14500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787579575.954370:0:14500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8200/0xb72beeaffa1b82ed lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d418 expref: 22 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579575.954390:0:14500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b82f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d418 expref: 21 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579575.954399:0:14500:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0ce96a86200) 00010000:00010000:0.0:1787579575.954402:0:14500:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787579575.954406:0:14500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c9600, rc 0) 00000100:00100000:0.0:1787579575.954501:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+21:14520:x1874412591765504:12345-192.168.206.53@tcp:101:cat.0 Request processed in 663us (893us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1787579575.954508:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 33 00000100:00100000:2.0:1787579575.957779:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579575.958448:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591765632 00000100:00100000:0.0:1787579575.958458:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591765632 00000100:00100000:0.0:1787579575.958518:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 1 00000100:00100000:0.0:1787579575.958527:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+21:2361:x1874412591765632:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579575.958543:0:14485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579575.958567:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9600/0xb72beeaffa1b82f4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d418 expref: 21 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579575.958584:0:14485:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0ce96a86200) 00010000:00010000:0.0:1787579575.958588:0:14485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579575.958662:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+20:2361:x1874412591765632:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 135us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579575.958669:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 1 00000100:00100000:2.0:1787579575.958765:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579575.958889:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591765888 00000100:00100000:3.0:1787579575.958894:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591765888 00000100:00100000:3.0:1787579575.958952:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:3.0:1787579575.958960:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+20:14520:x1874412591765888:12345-192.168.206.53@tcp:35:cat.0 00000100:00100000:3.0:1787579575.959269:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+21:14520:x1874412591765888:12345-192.168.206.53@tcp:35:cat.0 Request processed in 309us (504us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1787579575.959276:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:2.0:1787579576.045646:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579576.045821:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591766144 00000100:00100000:3.0:1787579576.045837:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591766144 00000100:00100000:3.0:1787579576.045972:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 34 00000100:00100000:3.0:1787579576.045983:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+21:14526:x1874412591766144:12345-192.168.206.53@tcp:101:dd.0 00010000:00010000:3.0:1787579576.046008:0:14502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579576.046027:0:14502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b8302 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d41f expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.046143:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00c00/0xb72beeaffa1b8309 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.046158:0:14502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00400/0xb72beeaffa1b82a7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3fc expref: 22 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.046166:0:14502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fe00/0xb72beeaffa1b82bc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d403 expref: 22 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.046174:0:14502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00c00/0xb72beeaffa1b8309 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.046760:0:14502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fe00/0xb72beeaffa1b82bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d403 expref: 22 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.046777:0:14502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fe00/0xb72beeaffa1b82bc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d403 expref: 22 pid: 16432 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579576.046810:0:14502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce8923b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14502:1874412616914944:192.168.206.53@tcp:104: 00010000:00010000:3.0:1787579576.047041:0:14502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00400/0xb72beeaffa1b82a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3fc expref: 22 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.047051:0:14502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00400/0xb72beeaffa1b82a7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3fc expref: 22 pid: 14501 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579576.047061:0:14502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce89238700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14502:1874412616915072:192.168.206.53@tcp:104: 00000100:00100000:3.0:1787579576.047090:0:14502:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9746a180 going to sleep for 11 seconds 00000100:00100000:1.0:1787579576.060228:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579576.060403:0:14502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce8923b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14502:1874412616914944:192.168.206.53@tcp:104: 00000100:00100000:3.0:1787579576.060429:0:14502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce89238700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14502:1874412616915072:192.168.206.53@tcp:104: 00010000:00010000:3.0:1787579576.060455:0:14502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00c00/0xb72beeaffa1b8309 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579576.060519:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579576.060600:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591766400 00000100:00100000:2.0:1787579576.060608:0:14487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591766400 00010000:00010000:2.0:1787579576.060643:0:14487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00400/0xb72beeaffa1b82a7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3fc expref: 23 pid: 14501 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579576.060678:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591766272 00000100:00100000:2.0:1787579576.060681:0:14487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591766272 00010000:00010000:2.0:1787579576.060708:0:14487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fe00/0xb72beeaffa1b82bc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d403 expref: 24 pid: 16432 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579576.060744:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:2.0:1787579576.060754:0:14487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebf868450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+24:2359:x1874412591766400:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787579576.060769:0:14487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579576.060777:0:14487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00400/0xb72beeaffa1b82a7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3fc expref: 24 pid: 14501 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579576.060788:0:14487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00400/0xb72beeaffa1b82a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3fc expref: 24 pid: 14501 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579576.060812:0:14487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00400/0xb72beeaffa1b82a7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d3fc expref: 24 pid: 14501 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579576.060833:0:14487:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0ce96a86200) 00010000:00010000:2.0:1787579576.060839:0:14487:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00c00/0xb72beeaffa1b8309 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579576.060848:0:14487:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00c00/0xb72beeaffa1b8309 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579576.060866:0:14487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579576.061216:0:14487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebf868450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+23:2359:x1874412591766400:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 452us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579576.061225:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:2.0:1787579576.061272:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:2.0:1787579576.061280:0:14487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba314380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+22:2359:x1874412591766272:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787579576.061288:0:14487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579576.061294:0:14487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fe00/0xb72beeaffa1b82bc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d403 expref: 22 pid: 16432 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579576.061305:0:14487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fe00/0xb72beeaffa1b82bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d403 expref: 22 pid: 16432 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579576.061318:0:14487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351fe00/0xb72beeaffa1b82bc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d403 expref: 22 pid: 16432 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579576.061328:0:14487:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0ce96a86200) 00010000:00010000:2.0:1787579576.061332:0:14487:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00c00/0xb72beeaffa1b8309 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579576.061340:0:14487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00c00/0xb72beeaffa1b8309 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579576.061347:0:14487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00c00/0xb72beeaffa1b8309 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579576.061365:0:14487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579576.061389:0:14487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba314380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+21:2359:x1874412591766272:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 110us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579576.061396:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 12 00010000:00010000:3.0:1787579576.061599:0:14502:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00c00/0xb72beeaffa1b8309 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.061607:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00c00/0xb72beeaffa1b8309 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579576.061624:0:14502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787579576.071776:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b8302 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d41f expref: 22 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.071812:0:14502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00c00/0xb72beeaffa1b8309 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d41f expref: 21 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.071835:0:14502:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0ce96a86200) 00010000:00010000:3.0:1787579576.071838:0:14502:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787579576.071842:0:14502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0cd82a00c00, rc 0) 00000100:00100000:3.0:1787579576.071959:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+21:14526:x1874412591766144:12345-192.168.206.53@tcp:101:dd.0 Request processed in 25977us (26326us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1787579576.071967:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 34 00000100:00100000:1.0:1787579576.089590:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579576.089686:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591766656 00000100:00100000:0.0:1787579576.089697:0:16432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591766656 00000100:00100000:0.0:1787579576.089755:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 35 00000100:00100000:0.0:1787579576.089766:0:16432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+21:14526:x1874412591766656:12345-192.168.206.53@tcp:36:dd.0 00010000:00010000:0.0:1787579576.090066:0:16432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b8317 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579576.090083:0:16432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b8317 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579576.090355:0:16432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b8317 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787579576.090414:0:16432:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1787579576.090443:0:16432:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020eda2dd reply state 000000005fbd1a51 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b8317 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579576.090452:0:16432:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787579576.090548:0:16432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+24:14526:x1874412591766656:12345-192.168.206.53@tcp:36:dd.0 Request processed in 783us (965us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787579576.090556:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 35 00000020:00080000:0.0:1787579576.090560:0:16432:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787579576.094258:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b8317 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579576.094274:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b8317 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579576.094281:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b8317 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579576.094283:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00010000:00010000:1.0:1787579576.094287:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:1.0:1787579576.094292:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b8317 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579576.094300:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b8317 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579576.094317:0:3306:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0ce96a86200) 00010000:00010000:1.0:1787579576.094321:0:3306:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787579576.094325:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b8317 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579576.094332:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b8317 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579576.095075:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591766784 00000100:00100000:3.0:1787579576.095086:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591766784 00000100:00100000:3.0:1787579576.095152:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 36 00000100:00100000:3.0:1787579576.095163:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+23:14526:x1874412591766784:12345-192.168.206.53@tcp:101:dd.0 00010000:00010000:3.0:1787579576.095185:0:14501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579576.095201:0:14501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b831e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d426 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.095253:0:14501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b831e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d426 expref: 24 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.095267:0:14501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b831e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d426 expref: 24 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.095285:0:14501:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0ce96a86200) 00010000:00010000:3.0:1787579576.095288:0:14501:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787579576.095290:0:14501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0cd82a00200, rc 0) 00000100:00100000:3.0:1787579576.095351:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+24:14526:x1874412591766784:12345-192.168.206.53@tcp:101:dd.0 Request processed in 190us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579576.095373:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 36 00000100:00100000:0.0:1787579576.118411:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579576.118586:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591767040 00000100:00100000:2.0:1787579576.118595:0:14487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591767040 00000100:00100000:2.0:1787579576.118658:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 2 00000100:00100000:2.0:1787579576.118668:0:14487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebab69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+24:14526:x1874412591767040:12345-192.168.206.53@tcp:103:dd.0 00010000:00010000:2.0:1787579576.118681:0:14487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579576.118703:0:14487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00200/0xb72beeaffa1b831e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d426 expref: 24 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579576.118727:0:14487:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0ce96a86200) 00010000:00010000:2.0:1787579576.118731:0:14487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579576.118785:0:14487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebab69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+23:14526:x1874412591767040:12345-192.168.206.53@tcp:103:dd.0 Request processed in 119us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579576.118793:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 2 00000100:00100000:1.0:1787579576.126620:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579576.126708:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591767168 00000100:00100000:2.0:1787579576.126718:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591767168 00000100:00100000:2.0:1787579576.126775:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 37 00000100:00100000:2.0:1787579576.126785:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+23:14526:x1874412591767168:12345-192.168.206.53@tcp:58:dd.0 00010000:00010000:2.0:1787579576.126889:0:14500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b8325 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579576.126904:0:14500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b8325 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579576.126915:0:14500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b8325 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787579576.127743:0:14500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787579576.127894:0:14500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1787579576.127996:0:14500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787579576.128126:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+23:14526:x1874412591767168:12345-192.168.206.53@tcp:58:dd.0 Request processed in 1339us (1511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579576.128137:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 37 00000100:00100000:3.0:1787579576.132071:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1787579576.133086:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591767296 00000100:00100000:1.0:1787579576.133107:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591767296 00000100:00100000:1.0:1787579576.133168:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 38 00000100:00100000:1.0:1787579576.133179:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+23:14526:x1874412591767296:12345-192.168.206.53@tcp:101:dd.0 00010000:00010000:1.0:1787579576.133198:0:14502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579576.133231:0:14502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f200/0xb72beeaffa1b832c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d42d expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579576.133286:0:14502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b8325 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579576.133298:0:14502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f200/0xb72beeaffa1b832c lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d42d expref: 24 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579576.133316:0:14502:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b8325 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579576.133327:0:14502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f200/0xb72beeaffa1b832c lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d42d expref: 24 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579576.133342:0:14502:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0ce96a86200) 00010000:00010000:1.0:1787579576.133346:0:14502:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787579576.133350:0:14502:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f200/0xb72beeaffa1b832c lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d42d expref: 24 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579576.133356:0:14502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0cd8351f200, rc 0) 00000100:00100000:1.0:1787579576.133419:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+24:14526:x1874412591767296:12345-192.168.206.53@tcp:101:dd.0 Request processed in 242us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579576.133427:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 38 00010000:00010000:3.0:1787579576.224772:0:16123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579576.288281:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787579576.288309:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceba315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616915200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787579576.288509:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579576.288660:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616915200 00000100:00100000:0.0:1787579576.288681:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616915200 00000100:00100000:0.0:1787579576.288758:0:15189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787579576.288771:0:15189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616915200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787579576.288812:0:15189:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787579576.289191:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceba315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3319:1874412616915200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787579576.289192:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616915456:0@lo:400:kworker.0 00000100:00100000:1.0:1787579576.289237:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec176b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616915584:0@lo:400:kworker.0 00000100:00100000:2.0:1787579576.289257:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579576.289550:0:15189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874412616915200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579576.289560:0:15189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787579576.289652:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1874412616915712:0@lo:400:kworker.0 00000100:00100000:1.0:1787579576.289705:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787579576.289754:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787579576.289766:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787579576.289780:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec176a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6514e2d9-be54-4793-9feb-dcbd6b926656:3322:1874412616915328:0@lo:400:kworker.0 00000100:00100000:2.0:1787579576.289825:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579576.289861:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3322:1874412616915840:0@lo:400:kworker.0 00000100:00100000:0.0:1787579576.290005:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616915456 00000100:00100000:0.0:1787579576.290011:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616915456 00000100:00100000:0.0:1787579576.290336:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787579576.290345:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616915456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579576.292683:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579576.292772:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616915328 00000100:00100000:2.0:1787579576.292780:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616915328 00000100:00100000:2.0:1787579576.292814:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787579576.292820:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce88250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+19:3322:x1874412616915328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579576.292866:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce88250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6514e2d9-be54-4793-9feb-dcbd6b926656+19:3322:x1874412616915328:12345-0@lo:400:kworker.0 Request processed in 47us (3042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579576.292871:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787579576.293155:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec176a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6514e2d9-be54-4793-9feb-dcbd6b926656:3322:1874412616915328:0@lo:400:kworker.0 00000100:00080000:2.0:1787579576.293277:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787579576.293291:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616915584 00000100:00100000:2.0:1787579576.293295:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616915584 00000100:00100000:2.0:1787579576.293324:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616915840 00000100:00100000:0.0:1787579576.293676:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1874412616915456:12345-0@lo:400:kworker.0 Request processed in 3331us (4419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579576.293686:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787579576.293724:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3322:1874412616915456:0@lo:400:kworker.0 00000100:00100000:0.0:1787579576.293749:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787579576.293759:0:16432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616915584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579576.293805:0:16432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874412616915584:12345-0@lo:400:kworker.0 Request processed in 49us (4101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579576.293811:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787579576.293838:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec176b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874412616915584:0@lo:400:kworker.0 00000100:00100000:2.0:1787579576.296143:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616915840 00000100:00080000:0.0:1787579576.296224:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787579576.296225:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787579576.296236:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1874412616915840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579576.296320:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1874412616915840:12345-0@lo:400:kworker.0 Request processed in 84us (3643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579576.296328:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787579576.296354:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3322:1874412616915840:0@lo:400:kworker.0 00000100:00100000:3.0:1787579576.300565:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579576.300659:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616915712 00000100:00100000:3.0:1787579576.300672:0:16432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616915712 00000100:00100000:3.0:1787579576.300749:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787579576.300762:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8923b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874412616915712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579576.300840:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8923b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874412616915712:12345-0@lo:400:kworker.0 Request processed in 80us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579576.300849:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787579576.300917:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3320:1874412616915712:0@lo:400:kworker.0 00000100:00080000:1.0:1787579576.307563:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1787579576.406063:0:5888:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000001:00080000:3.0:1787579576.406116:0:5888:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000040:00080000:3.0:1787579576.928176:0:14534:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787579576.928184:0:14534:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787579576.928222:0:14534:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787579576.928229:0:14534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787579576.928340:0:14534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce89238e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14534:1874412616915968:192.168.206.53@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787579576.928451:0:14534:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9746a240 going to sleep for 11 seconds 00000100:00100000:3.0:1787579576.934752:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579576.935667:0:14511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591767424 00000100:00100000:0.0:1787579576.935678:0:14511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591767424 00000100:00100000:0.0:1787579576.935747:0:14511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:0.0:1787579576.935757:0:14511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce8923bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+12:14527:x1874412591767424:12345-192.168.206.53@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787579576.935840:0:14511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce8923bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+12:14527:x1874412591767424:12345-192.168.206.53@tcp:900:lhsmtool_posix.0 Request processed in 84us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579576.935848:0:14511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:1.0:1787579576.940682:0:14534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce89238e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14534:1874412616915968:192.168.206.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787579576.942545:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579576.942774:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591767552 00000100:00100000:2.0:1787579576.942784:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591767552 00000100:00100000:2.0:1787579576.942845:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 39 00000100:00100000:2.0:1787579576.942855:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+11:14527:x1874412591767552:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787579576.942885:0:14501:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787579576.943170:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+11:14527:x1874412591767552:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 Request processed in 315us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579576.943178:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 39 00000100:00100000:2.0:1787579576.949797:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579576.950355:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591767680 00000100:00100000:3.0:1787579576.950484:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591767680 00000100:00100000:3.0:1787579576.950601:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 40 00000100:00100000:3.0:1787579576.950611:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+11:14527:x1874412591767680:12345-192.168.206.53@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787579576.950692:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8333 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.950707:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8333 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.950719:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8333 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.950783:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b833a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.950791:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b833a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.950797:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b833a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.950818:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b8341 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.950826:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b8341 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.950833:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b8341 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787579576.950877:0:14502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787579576.950881:0:14502:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787579576.950893:0:14502:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b8341 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.950903:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8333 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.950916:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8333 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.950924:0:14502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8333 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.950962:0:14502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd82a01800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579576.950967:0:14502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8333 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.950983:0:14502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8333 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.950997:0:14502:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0ce96a86f00) 00010000:00010000:3.0:1787579576.951000:0:14502:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579576.951005:0:14502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8333 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.951011:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01800/0xb72beeaffa1b8333 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.951033:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b833a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.951038:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b833a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.951044:0:14502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b833a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.951049:0:14502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd82a00800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579576.951059:0:14502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b833a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.951065:0:14502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b833a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.951074:0:14502:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffffa0ce96a86b00) 00010000:00010000:3.0:1787579576.951077:0:14502:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579576.951080:0:14502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b833a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.951097:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b833a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.951117:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b8341 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.951123:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b8341 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.951128:0:14502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b8341 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.951134:0:14502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd82a01600 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579576.951137:0:14502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b8341 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.951142:0:14502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b8341 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.951149:0:14502:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0ce96a86200) 00010000:00010000:3.0:1787579576.951152:0:14502:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579576.951162:0:14502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b8341 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.951169:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b8341 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579576.951245:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+11:14527:x1874412591767680:12345-192.168.206.53@tcp:34:lhsmtool_posix.0 Request processed in 636us (1456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579576.951252:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 40 00000100:00100000:3.0:1787579576.956324:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579576.956469:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591767936 00000100:00100000:0.0:1787579576.956478:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591767936 00000100:00100000:0.0:1787579576.956578:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 41 00000100:00100000:0.0:1787579576.956589:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+11:14527:x1874412591767936:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787579576.956607:0:14500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579576.956626:0:14500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9800/0xb72beeaffa1b8348 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d434 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579576.956715:0:14500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b834f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579576.956729:0:14500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b834f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579576.956740:0:14500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b834f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787579576.956749:0:14500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787579576.956884:0:14500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b834f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579576.956901:0:14500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b834f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579576.956964:0:14500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b834f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579576.956971:0:14500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9a00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579576.956983:0:14500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b834f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579576.956991:0:14500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b834f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579576.957003:0:14500:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0ce96a86200) 00010000:00010000:0.0:1787579576.957006:0:14500:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787579576.957011:0:14500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b834f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579576.957017:0:14500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b834f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579576.957227:0:14500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9800/0xb72beeaffa1b8348 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d434 expref: 13 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579576.957239:0:14500:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0ce96a86f00) 00010000:00010000:0.0:1787579576.957241:0:14500:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787579576.957245:0:14500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9800/0xb72beeaffa1b8348 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d434 expref: 13 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579576.957254:0:14500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c9800, rc 0) 00000100:00100000:0.0:1787579576.957318:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+12:14527:x1874412591767936:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 730us (1001us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1787579576.957335:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 41 00000100:00100000:1.0:1787579576.964702:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579576.964825:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591768064 00000100:00100000:0.0:1787579576.964835:0:16432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591768064 00000100:00100000:0.0:1787579576.964939:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 42 00000100:00100000:0.0:1787579576.964950:0:16432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceba316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+12:14527:x1874412591768064:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787579576.964981:0:16432:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787579576.965108:0:16432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceba316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+12:14527:x1874412591768064:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 Request processed in 160us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579576.965117:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 42 00000100:00100000:1.0:1787579576.978707:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579576.978796:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591768320 00000100:00100000:2.0:1787579576.978806:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591768320 00000100:00100000:2.0:1787579576.978920:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 43 00000100:00100000:2.0:1787579576.978959:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+12:14527:x1874412591768320:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787579576.978988:0:14501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579576.979008:0:14501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b835d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d43b expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787579576.979790:0:14501:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1787579576.979798:0:14501:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1787579576.979844:0:14501:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1787579576.980164:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b8364 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579576.980186:0:14501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b8364 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579576.980197:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b8364 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579576.980261:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b835d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d43b expref: 15 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579576.980280:0:14501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b8364 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d43b expref: 14 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579576.980288:0:14501:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0cea147d500) 00010000:00010000:2.0:1787579576.980291:0:14501:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787579576.980295:0:14501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba318600, rc 0) 00000100:00100000:2.0:1787579576.980352:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+14:14527:x1874412591768320:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 1423us (1653us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1787579576.980360:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 43 00000100:00100000:2.0:1787579576.995013:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579576.995172:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591768576 00000100:00100000:3.0:1787579576.995182:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591768576 00000100:00100000:3.0:1787579576.995235:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 44 00000100:00100000:3.0:1787579576.995246:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+14:14527:x1874412591768576:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787579576.995305:0:14502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579576.995334:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318600/0xb72beeaffa1b8364 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d43b expref: 14 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.995350:0:14502:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0cea147d500) 00010000:00010000:3.0:1787579576.995372:0:14502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787579576.995397:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b8372 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.995410:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b8372 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.995419:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b8372 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.995432:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b8379 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9edf0732 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.995451:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b8379 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9edf0732 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.995458:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b8379 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9edf0732 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.995714:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b8372 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.995748:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b8372 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.995755:0:14502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b8372 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.995761:0:14502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd82a01600 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579576.995765:0:14502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b8372 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.995772:0:14502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b8372 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.995781:0:14502:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0ce96a86500) 00010000:00010000:3.0:1787579576.995784:0:14502:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579576.995788:0:14502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b8372 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.995795:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b8372 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.995805:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b8379 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9edf0732 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.995818:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b8379 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9edf0732 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.995824:0:14502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b8379 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9edf0732 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.995829:0:14502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd82a00800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579576.995831:0:14502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b8379 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9edf0732 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.995837:0:14502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b8379 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9edf0732 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.995845:0:14502:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x9edf0732 (ffffa0ce96a86b00) 00010000:00010000:3.0:1787579576.995848:0:14502:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579576.995851:0:14502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b8379 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9edf0732 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579576.995857:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b8379 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9edf0732 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579576.995988:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+13:14527:x1874412591768576:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 742us (984us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787579576.995995:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 44 00000100:00100000:1.0:1787579577.000268:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579577.000618:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591768704 00000100:00100000:0.0:1787579577.000629:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591768704 00000100:00100000:0.0:1787579577.000685:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 45 00000100:00100000:0.0:1787579577.000695:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+13:14527:x1874412591768704:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787579577.000713:0:14500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579577.000738:0:14500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b8380 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d442 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.000771:0:14500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b8387 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.000785:0:14500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b8387 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.000804:0:14500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b8387 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.001077:0:14500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9a00/0xb72beeaffa1b8380 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d442 expref: 15 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.001112:0:14500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8800/0xb72beeaffa1b8387 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d442 expref: 14 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.001121:0:14500:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0ce82cbb000) 00010000:00010000:0.0:1787579577.001124:0:14500:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787579577.001127:0:14500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba3c8800, rc 0) 00000100:00100000:0.0:1787579577.001188:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+14:14527:x1874412591768704:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 494us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579577.001196:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 45 00000100:00100000:0.0:1787579577.006313:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579577.006593:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591768960 00000100:00100000:3.0:1787579577.006604:0:16432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591768960 00000100:00100000:3.0:1787579577.006675:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 46 00000100:00100000:3.0:1787579577.006686:0:16432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+14:14527:x1874412591768960:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787579577.006763:0:16432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b838e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579577.006791:0:16432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b838e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579577.006802:0:16432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b838e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787579577.007461:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1787579577.007556:0:16432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1787579577.007568:0:16432:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 513198641474ns, next at 514198639043ns, rc = 0 00000004:00010000:3.0:1787579577.007656:0:16432:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004951a4c4 reply state 00000000f114227b transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b838e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579577.007666:0:16432:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787579577.007803:0:16432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+16:14527:x1874412591768960:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 1117us (1497us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1787579577.007811:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 46 00010000:00010000:0.0:1787579577.021754:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b838e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.021771:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b838e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.021779:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b838e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.021785:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd82a00800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:0.0:1787579577.021789:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b838e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.021796:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b838e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.021812:0:3305:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0ce82cbb000) 00010000:00010000:0.0:1787579577.021816:0:3305:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787579577.021835:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b838e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.021841:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a00800/0xb72beeaffa1b838e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579577.022685:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579577.022873:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591769088 00000100:00100000:2.0:1787579577.022883:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591769088 00000100:00100000:2.0:1787579577.022978:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 47 00000100:00100000:2.0:1787579577.022989:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+15:14527:x1874412591769088:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787579577.023011:0:14501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579577.023029:0:14501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b8395 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d449 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.023121:0:14501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b8395 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d449 expref: 16 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.023135:0:14501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b8395 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d449 expref: 16 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.023156:0:14501:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0ce82cbb000) 00010000:00010000:2.0:1787579577.023158:0:14501:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787579577.023162:0:14501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319800, rc 0) 00000100:00100000:2.0:1787579577.023210:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+16:14527:x1874412591769088:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 224us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579577.023217:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 47 00000100:00100000:3.0:1787579577.032051:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579577.032382:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591769216 00000100:00100000:2.0:1787579577.032392:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591769216 00000100:00100000:2.0:1787579577.032502:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 14 00000100:00100000:2.0:1787579577.032513:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+5:2362:x1874412591769216:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787579577.032867:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+6:2362:x1874412591769216:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 Request processed in 354us (825us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787579577.032884:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 14 00000100:00080000:1.0:1787579577.038519:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787579577.044111:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579577.044296:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591769472 00000100:00100000:3.0:1787579577.044305:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591769472 00000100:00100000:3.0:1787579577.044361:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00100000:3.0:1787579577.044371:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+16:14527:x1874412591769472:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787579577.044601:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+17:14527:x1874412591769472:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 Request processed in 231us (500us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1787579577.044609:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00100000:2.0:1787579577.047472:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579577.047549:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591769728 00000100:00100000:3.0:1787579577.047558:0:16432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591769728 00000100:00100000:3.0:1787579577.047612:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 48 00000100:00100000:3.0:1787579577.047623:0:16432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+17:14527:x1874412591769728:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787579577.047744:0:16432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+17:14527:x1874412591769728:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 121us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579577.047752:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 48 00000100:00100000:0.0:1787579577.055339:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579577.055494:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591769856 00000100:00100000:2.0:1787579577.055504:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591769856 00000100:00100000:2.0:1787579577.055566:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 49 00000100:00100000:2.0:1787579577.055576:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+17:14527:x1874412591769856:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787579577.055594:0:14501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579577.055622:0:14501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b839c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d450 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.055689:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b83a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.055701:0:14501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b83a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.055711:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b83a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787579577.055743:0:14501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787579577.055759:0:14501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b83a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.055782:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba318e00/0xb72beeaffa1b839c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d450 expref: 19 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.055799:0:14501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b83a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d450 expref: 18 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.055806:0:14501:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0ce82cbb000) 00010000:00010000:2.0:1787579577.055808:0:14501:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787579577.055812:0:14501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba319400, rc 0) 00000100:00100000:2.0:1787579577.055883:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+18:14527:x1874412591769856:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 307us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579577.055890:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 49 00000100:00100000:1.0:1787579577.062771:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579577.066305:0:15485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591769984 00000100:00100000:2.0:1787579577.066318:0:15485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591769984 00000100:00100000:2.0:1787579577.066381:0:15485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 15 00000100:00100000:2.0:1787579577.066390:0:15485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+6:2360:x1874412591769984:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787579577.066406:0:15485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579577.067017:0:15485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a33515fc/0xb72beeaffa1b83aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d457 expref: -99 pid: 15485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787579577.067508:0:15485:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c4cb8, blocks: 0x1 00010000:00010000:2.0:1787579577.067533:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=513s v=(0 0) 00010000:00010000:2.0:1787579577.067537:0:15485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579577.067549:0:15485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a33515fc/0xb72beeaffa1b83aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d457 expref: 7 pid: 15485 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.067573:0:15485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a33515fc/0xb72beeaffa1b83aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d457 expref: 7 pid: 15485 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.067587:0:15485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba318e00, rc 0) 00000100:00100000:2.0:1787579577.067651:0:15485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+7:2360:x1874412591769984:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 1261us (4888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579577.067659:0:15485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 15 00000100:00100000:3.0:1787579577.070533:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579577.070620:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591770240 00000100:00100000:0.0:1787579577.070629:0:16432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591770240 00000100:00100000:0.0:1787579577.070685:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 50 00000100:00100000:0.0:1787579577.070694:0:16432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+18:14527:x1874412591770240:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787579577.070793:0:16432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+18:14527:x1874412591770240:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 100us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579577.070801:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 50 00000100:00100000:0.0:1787579577.075583:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579577.075802:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591770368 00000100:00100000:2.0:1787579577.075813:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591770368 00000100:00100000:2.0:1787579577.075884:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 51 00000100:00100000:2.0:1787579577.075894:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+18:14527:x1874412591770368:12345-192.168.206.53@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787579577.150869:0:5888:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:0.0:1787579577.151041:0:5888:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:0.0:1787579577.151049:0:5888:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1787579577.151055:0:5888:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787579577.151285:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787579577.151302:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ce8923ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616916096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787579577.151363:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579577.151568:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616916096 00000100:00100000:2.0:1787579577.151576:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616916096 00000100:00100000:2.0:1787579577.151625:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787579577.151646:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce89238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1874412616916096:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787579577.151789:0:15187:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787579577.151793:0:15187:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1787579577.151795:0:15187:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787579577.151798:0:15187:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787579576 -> 1787579576 00002000:00010000:2.0:1787579577.151800:0:15187:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787579577.151872:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce89238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3321:x1874412616916096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 228us (508us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1787579577.151880:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:2.0:1787579577.152144:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0ce8923ad80/2, rc 0, transno 8589934595 00000100:00100000:2.0:1787579577.152151:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ce8923ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3321:1874412616916096:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787579577.152243:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+14:14527:x1874412591770368:12345-192.168.206.53@tcp:44:lhsmtool_posix.0 Request processed in 76349us (76670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579577.152251:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 51 00000100:00100000:1.0:1787579577.156297:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579577.156849:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591770496 00000100:00100000:0.0:1787579577.156871:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591770496 00000100:00100000:0.0:1787579577.156970:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 17 00000100:00100000:0.0:1787579577.156981:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+7:2360:x1874412591770496:12345-192.168.206.53@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787579577.157118:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+7:2360:x1874412591770496:12345-192.168.206.53@tcp:16:lhsmtool_posix.0 Request processed in 139us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579577.157125:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 17 00000100:00100000:2.0:1787579577.160748:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579577.160850:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591770752 00000100:00100000:0.0:1787579577.160883:0:16432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591770752 00000100:00100000:0.0:1787579577.161197:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 52 00000100:00100000:0.0:1787579577.161208:0:16432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+14:14527:x1874412591770752:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787579577.161258:0:16432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579577.161283:0:16432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319400/0xb72beeaffa1b83a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d450 expref: 14 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.161299:0:16432:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0ce82cbb000) 00010000:00010000:0.0:1787579577.161303:0:16432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787579577.161330:0:16432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b83b1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.161341:0:16432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b83b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.161350:0:16432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b83b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787579577.161620:0:16432:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed77d67b reply state 00000000575d0f4f transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b83b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579577.161630:0:16432:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787579577.162204:0:16432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+15:14527:x1874412591770752:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 996us (1462us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787579577.162212:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 52 00000100:00100000:1.0:1787579577.168610:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00010000:00010000:3.0:1787579577.169357:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b83b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579577.169372:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b83b1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579577.169379:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b83b1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579577.169386:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:3.0:1787579577.169392:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b83b1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579577.169401:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b83b1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579577.169429:0:3306:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0ce82cbb000) 00010000:00010000:3.0:1787579577.169433:0:3306:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787579577.169439:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b83b1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579577.169445:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9200/0xb72beeaffa1b83b1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579577.171596:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591770880 00000100:00100000:2.0:1787579577.171610:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591770880 00000100:00100000:2.0:1787579577.171722:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 18 00000100:00100000:2.0:1787579577.171734:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+7:14527:x1874412591770880:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787579577.171751:0:15187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579577.171771:0:15187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000983e2502/0xb72beeaffa1b83b8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x843efc5b6f01d45e expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.171803:0:15187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a33515fc/0xb72beeaffa1b83aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d457 expref: 8 pid: 15485 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.171844:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579577.171849:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579577.171865:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000983e2502/0xb72beeaffa1b83b8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d45e expref: 8 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.172405:0:15187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a33515fc/0xb72beeaffa1b83aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d457 expref: 8 pid: 15485 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.172423:0:15187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a33515fc/0xb72beeaffa1b83aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d457 expref: 8 pid: 15485 timeout: 613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579577.172438:0:15187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a67b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15187:1874412616916224:192.168.206.53@tcp:104: 00000100:00100000:2.0:1787579577.172534:0:15187:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cebf804cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787579577.178431:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579577.178506:0:16621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591771008 00000100:00100000:3.0:1787579577.178526:0:16621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591771008 00000100:00100000:0.0:1787579577.178538:0:15187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a67b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15187:1874412616916224:192.168.206.53@tcp:104: 00010000:00010000:3.0:1787579577.178563:0:16621:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a33515fc/0xb72beeaffa1b83aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d457 expref: 9 pid: 15485 timeout: 613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.178565:0:15187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000983e2502/0xb72beeaffa1b83b8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d45e expref: 9 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.178601:0:15187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ceba318c00, rc 0) 00000100:00100000:3.0:1787579577.178603:0:16621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 13 00000100:00100000:3.0:1787579577.178611:0:16621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+9:2359:x1874412591771008:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787579577.178623:0:16621:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579577.178643:0:16621:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a33515fc/0xb72beeaffa1b83aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d457 expref: 9 pid: 15485 timeout: 613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579577.178656:0:16621:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a33515fc/0xb72beeaffa1b83aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d457 expref: 9 pid: 15485 timeout: 613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579577.178656:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+9:14527:x1874412591770880:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 6925us (10549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579577.178664:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 18 00010000:00010000:3.0:1787579577.178677:0:16621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a33515fc/0xb72beeaffa1b83aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d457 expref: 8 pid: 15485 timeout: 613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579577.178690:0:16621:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579577.178694:0:16621:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579577.178700:0:16621:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000983e2502/0xb72beeaffa1b83b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d45e expref: 7 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579577.178710:0:16621:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000983e2502/0xb72beeaffa1b83b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d45e expref: 7 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579577.178756:0:16621:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000983e2502/0xb72beeaffa1b83b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d45e expref: 7 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579577.178769:0:16621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb480c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:16621:1874412616916352:192.168.206.53@tcp:105: 00000100:00100000:3.0:1787579577.178815:0:16621:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce84fe29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787579577.183269:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579577.183353:0:16621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb480c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:16621:1874412616916352:192.168.206.53@tcp:105: 00010000:00010000:3.0:1787579577.183376:0:16621:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579577.183432:0:16621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+7:2359:x1874412591771008:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 4821us (5011us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579577.183443:0:16621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 13 00000100:00100000:1.0:1787579577.183861:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591771136 00000100:00100000:1.0:1787579577.183869:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591771136 00000100:00100000:1.0:1787579577.183919:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 19 00000100:00100000:1.0:1787579577.183961:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+7:2359:x1874412591771136:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787579577.184158:0:15185:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787579577.184162:0:15185:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787579575 00002000:00010000:1.0:1787579577.184164:0:15185:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787579574 00002000:00010000:1.0:1787579577.184166:0:15185:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787579576 -> 1787579575 00002000:00010000:1.0:1787579577.184169:0:15185:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787579577.184205:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+8:2359:x1874412591771136:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 Request processed in 277us (945us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787579577.184212:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 19 00000100:00100000:0.0:1787579577.196022:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579577.196114:0:15186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591771264 00000100:00100000:3.0:1787579577.196123:0:15186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591771264 00000100:00100000:2.0:1787579577.196228:0:15186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 20 00000100:00100000:2.0:1787579577.196240:0:15186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+8:2360:x1874412591771264:12345-192.168.206.53@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787579577.196284:0:15186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000020907ad4/0xb72beeaffa1b83bf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.196303:0:15186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000983e2502/0xb72beeaffa1b83b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d45e expref: 8 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.196312:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579577.196329:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787579577.196333:0:15186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020907ad4/0xb72beeaffa1b83bf lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.196367:0:15186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000983e2502/0xb72beeaffa1b83b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d45e expref: 8 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.196381:0:15186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000983e2502/0xb72beeaffa1b83b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d45e expref: 8 pid: 15187 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579577.196397:0:15186:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15186:1874412616916480:192.168.206.53@tcp:104: 00000100:00100000:2.0:1787579577.196800:0:15186:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0cebf804cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787579577.200120:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579577.200280:0:15186:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15186:1874412616916480:192.168.206.53@tcp:104: 00010000:00010000:2.0:1787579577.200305:0:15186:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000020907ad4/0xb72beeaffa1b83bf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579577.200333:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591771392 00000100:00100000:0.0:1787579577.200340:0:14487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591771392 00010000:00010000:0.0:1787579577.200372:0:14487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000983e2502/0xb72beeaffa1b83b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d45e expref: 9 pid: 15187 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579577.200413:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 14 00000100:00100000:0.0:1787579577.200423:0:14487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+9:2360:x1874412591771392:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787579577.200437:0:14487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579577.200459:0:14487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000983e2502/0xb72beeaffa1b83b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d45e expref: 9 pid: 15187 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.200472:0:14487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000983e2502/0xb72beeaffa1b83b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d45e expref: 9 pid: 15187 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.200493:0:14487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000983e2502/0xb72beeaffa1b83b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d45e expref: 9 pid: 15187 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.200642:0:14487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787579577.200660:0:14487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787579577.200666:0:14487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000020907ad4/0xb72beeaffa1b83bf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.200676:0:14487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020907ad4/0xb72beeaffa1b83bf lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.200707:0:14487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579577.200764:0:14487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+8:2360:x1874412591771392:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 342us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579577.200772:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 14 00010000:00010000:2.0:1787579577.200788:0:15186:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000020907ad4/0xb72beeaffa1b83bf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.200798:0:15186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020907ad4/0xb72beeaffa1b83bf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.200822:0:15186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000020907ad4/0xb72beeaffa1b83bf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.200830:0:15186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020907ad4/0xb72beeaffa1b83bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.200843:0:15186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020907ad4/0xb72beeaffa1b83bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.200850:0:15186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba318600 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579577.200854:0:15186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020907ad4/0xb72beeaffa1b83bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.200864:0:15186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020907ad4/0xb72beeaffa1b83bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.200875:0:15186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020907ad4/0xb72beeaffa1b83bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.200882:0:15186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020907ad4/0xb72beeaffa1b83bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579577.200990:0:15186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+7:2360:x1874412591771264:12345-192.168.206.53@tcp:1:lhsmtool_posix.0 Request processed in 4753us (4977us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579577.200998:0:15186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 20 00000100:00100000:3.0:1787579577.204608:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579577.204673:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591771648 00000100:00100000:0.0:1787579577.204682:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591771648 00000100:00100000:0.0:1787579577.204736:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 53 00000100:00100000:0.0:1787579577.204746:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+14:14527:x1874412591771648:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787579577.204821:0:14500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b83c6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.204837:0:14500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b83c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.204849:0:14500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b83c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.205311:0:14500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b83cd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.205324:0:14500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b8395 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d449 expref: 15 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.205345:0:14500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b83cd lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.205377:0:14500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b8395 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d449 expref: 15 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.205390:0:14500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b8395 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d449 expref: 15 pid: 14501 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579577.205405:0:14500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a60000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14500:1874412616916608:192.168.206.53@tcp:104: 00000100:00100000:0.0:1787579577.205486:0:14500:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceba1e00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787579577.209333:0:14500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a60000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14500:1874412616916608:192.168.206.53@tcp:104: 00010000:00010000:2.0:1787579577.209361:0:14500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b83cd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579577.216366:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579577.216459:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591771776 00000100:00100000:2.0:1787579577.216469:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591771776 00010000:00010000:2.0:1787579577.216518:0:14486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b8395 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d449 expref: 16 pid: 14501 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579577.216555:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 15 00000100:00100000:2.0:1787579577.216564:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+16:2360:x1874412591771776:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787579577.216579:0:14486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579577.216586:0:14486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b8395 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d449 expref: 16 pid: 14501 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.216599:0:14486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b8395 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d449 expref: 16 pid: 14501 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.216620:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b8395 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d449 expref: 16 pid: 14501 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.216636:0:14486:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0ce82cbb000) 00010000:00010000:2.0:1787579577.216641:0:14486:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b83cd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.216650:0:14486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b83cd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.216657:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b83cd lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.216694:0:14486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579577.216750:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8f2a5beb-cf32-4efe-802b-47d95029e6c6+15:2360:x1874412591771776:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 186us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579577.216756:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 15 00010000:00010000:0.0:1787579577.216828:0:14500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b83cd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.216837:0:14500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b83cd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787579577.217072:0:14500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1787579577.217223:0:14500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1787579577.217269:0:14500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1787579577.217345:0:14500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a63800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14500:1874412616916736:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787579577.217434:0:14500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579577.217460:0:14500:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ceba1e00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787579577.217637:0:14505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616916736 00000100:00100000:2.0:1787579577.217643:0:14505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616916736 00000100:00100000:2.0:1787579577.217676:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787579577.217684:0:14505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14500:x1874412616916736:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787579577.217759:0:14505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14500:x1874412616916736:12345-0@lo:1000:mdt00_000.0 Request processed in 76us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579577.217766:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787579577.217801:0:14500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a63800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14500:1874412616916736:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787579577.218449:0:14500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787579577.218509:0:14500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14500:1874412616916864:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787579577.218554:0:14500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579577.218583:0:14505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616916864 00000100:00100000:2.0:1787579577.218588:0:14505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616916864 00000100:00100000:2.0:1787579577.218615:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787579577.218622:0:14505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14500:x1874412616916864:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787579577.218754:0:14505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14500:x1874412616916864:12345-0@lo:1000:mdt00_000.0 Request processed in 131us (199us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787579577.218762:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787579577.218781:0:14500:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce865e99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787579577.218800:0:14500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14500:1874412616916864:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787579577.218826:0:14500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b83cd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.218835:0:14500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b83cd lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.218842:0:14500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b83cd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.218854:0:14500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9e00 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579577.218859:0:14500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b83cd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.218866:0:14500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b83cd lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.219635:0:14500:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0ce82cbb000) 00010000:00010000:2.0:1787579577.219640:0:14500:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787579577.219646:0:14500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b83cd lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.219652:0:14500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c9e00/0xb72beeaffa1b83cd lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.219680:0:14500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b8325 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.219686:0:14500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b8325 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.219691:0:14500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b8325 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.219696:0:14500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba319200 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579577.219699:0:14500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b8325 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.219704:0:14500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b8325 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.219726:0:14500:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0ce96a86200) 00010000:00010000:2.0:1787579577.219729:0:14500:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787579577.219735:0:14500:0:(ldlm_inodebits.c:109:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f200/0xb72beeaffa1b832c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d42d expref: 18 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.219745:0:14500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f200/0xb72beeaffa1b832c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d42d expref: 18 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.219753:0:14500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f200/0xb72beeaffa1b832c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d42d expref: 18 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.219806:0:14500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd8351f200/0xb72beeaffa1b832c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x843efc5b6f01d42d expref: 18 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579577.219819:0:14500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0cec1a65880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14500:1874412616916992:192.168.206.53@tcp:105: 00000100:00100000:2.0:1787579577.220503:0:14500:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0ce9191e480 going to sleep for 11 seconds 00000100:00100000:2.0:1787579577.223955:0:14500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0cec1a65880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14500:1874412616916992:192.168.206.53@tcp:105: 00010000:00010000:2.0:1787579577.223987:0:14500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b8325 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.223996:0:14500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319200/0xb72beeaffa1b8325 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.224034:0:14500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b83d4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.224047:0:14500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b83d4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.224070:0:14500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b83d4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.224081:0:14500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b83d4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.224096:0:14500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b83d4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.224103:0:14500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b83d4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.224109:0:14500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba319800 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579577.224113:0:14500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b83d4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.224123:0:14500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b83d4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.224135:0:14500:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0ce96a86200) 00010000:00010000:2.0:1787579577.224138:0:14500:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787579577.224141:0:14500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b83d4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.224147:0:14500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba319800/0xb72beeaffa1b83d4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.224156:0:14500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b83c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.224162:0:14500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b83c6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.224178:0:14500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b83c6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.224183:0:14500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8400 already unused, calling callback (ffffffffc20934f0) 00010000:00010000:2.0:1787579577.224186:0:14500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b83c6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.224193:0:14500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b83c6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.224201:0:14500:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0ce96a86200) 00010000:00010000:2.0:1787579577.224204:0:14500:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787579577.224206:0:14500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b83c6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.224211:0:14500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ceba3c8400/0xb72beeaffa1b83c6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579577.224475:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+18:14527:x1874412591771648:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 19728us (19874us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787579577.224485:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 53 00000020:00080000:2.0:1787579577.224490:0:14500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1787579577.226238:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579577.226317:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591771904 00000100:00100000:3.0:1787579577.226326:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591771904 00000100:00100000:3.0:1787579577.226377:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:3.0:1787579577.226386:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cebfa2b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+18:14526:x1874412591771904:12345-192.168.206.53@tcp:49:dd.0 00000100:00100000:3.0:1787579577.226507:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cebfa2b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+18:14526:x1874412591771904:12345-192.168.206.53@tcp:49:dd.0 Request processed in 121us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579577.226515:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 10 00000040:00080000:1.0:1787579577.230373:0:14534:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787579577.230381:0:14534:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787579577.230412:0:14534:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787579577.230418:0:14534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787579577.230919:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579577.231244:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591772160 00000100:00100000:3.0:1787579577.231253:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591772160 00000100:00100000:3.0:1787579577.231310:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:3.0:1787579577.231319:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+18:14527:x1874412591772160:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787579577.231969:0:14503:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787579577.232097:0:14503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1787579577.232141:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b83db lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579577.232157:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b83db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579577.232168:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b83db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579577.232175:0:14503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b83db lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579577.232182:0:14503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b83db lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579577.232188:0:14503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b83db lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579577.232210:0:14503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787579577.232299:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+20:14527:x1874412591772160:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 Request processed in 978us (1382us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1787579577.232307:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 11 00000020:00080000:3.0:1787579577.232311:0:14503:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787579577.232547:0:14488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787579577.232554:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b83db lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.232568:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd82a01600 already unused, calling callback (ffffffffc1654230) 00010000:00010000:0.0:1787579577.232572:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b83db lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.232579:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b83db lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.232593:0:14488:0:(ldlm_inodebits.c:90:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0ce82cbb000) 00010000:00010000:0.0:1787579577.232595:0:14488:0:(ldlm_inodebits.c:92:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787579577.232599:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b83db lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.232605:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0cd82a01600/0xb72beeaffa1b83db lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.232618:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579577.232620:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579577.232622:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579577.248370:0:16124:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579577.395750:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579577.395845:0:15190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591772288 00000100:00100000:2.0:1787579577.395854:0:15190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591772288 00000100:00100000:2.0:1787579577.395916:0:15190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:2.0:1787579577.395939:0:15190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+7:2359:x1874412591772288:12345-192.168.206.53@tcp:4:dd.0 00002000:00010000:2.0:1787579577.395984:0:15190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a8c4cb7, atime: 0x6a8c4cb6, ctime: 0x6a8c4cb7, blocks: 0x1 00010000:00010000:2.0:1787579577.396005:0:15190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c3a2965/0xb72beeaffa1b83e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.396020:0:15190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=513s v=(0 0) 00010000:00010000:2.0:1787579577.396024:0:15190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579577.396031:0:15190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c3a2965/0xb72beeaffa1b83e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.396044:0:15190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c3a2965/0xb72beeaffa1b83e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579577.405379:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579577.407146:0:15192:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787579577.407170:0:15192:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1787579577.407354:0:15192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591772416 00000100:00100000:2.0:1787579577.407366:0:15192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591772416 00000100:00100000:0.0:1787579577.407430:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579577.407476:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579577.407487:0:15192:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787579577.407501:0:15192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591772544 00000100:00100000:2.0:1787579577.407509:0:15192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591772544 00000100:00100000:0.0:1787579577.407509:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579577.407528:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579577.407542:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1787579577.407656:0:15192:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787579577.407662:0:15192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591772672 00000100:00100000:2.0:1787579577.407665:0:15192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591772672 00000100:00100000:2.0:1787579577.407677:0:15192:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787579577.407682:0:15192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591772800 00000100:00100000:2.0:1787579577.407685:0:15192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591772800 00000100:00100000:2.0:1787579577.407699:0:15192:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787579577.407706:0:15192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591772928 00000100:00100000:2.0:1787579577.407709:0:15192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591772928 00000100:00100000:2.0:1787579577.407722:0:15192:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787579577.407726:0:15192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591773056 00000100:00100000:2.0:1787579577.407729:0:15192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591773056 00000100:00100000:2.0:1787579577.408165:0:16734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 1 00000100:00100000:2.0:1787579577.408175:0:16734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb46b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+14:2359:x1874412591772416:12345-192.168.206.53@tcp:4:dd.0 00010000:00010000:2.0:1787579577.408226:0:16734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003271d93f/0xb72beeaffa1b83e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.408244:0:16734:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579577.408249:0:16734:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579577.408255:0:16734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003271d93f/0xb72beeaffa1b83e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.408268:0:16734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003271d93f/0xb72beeaffa1b83e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579577.420140:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1787579577.420233:0:15192:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787579577.420247:0:15192:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1787579577.420349:0:15192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591773184 00000100:00100000:3.0:1787579577.420357:0:15192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591773184 00000100:00100000:3.0:1787579577.421021:0:16735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 2 00000100:00100000:3.0:1787579577.421035:0:16735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8f2a5beb-cf32-4efe-802b-47d95029e6c6+16:2360:x1874412591772544:12345-192.168.206.53@tcp:4:dd.0 00010000:00010000:3.0:1787579577.421075:0:16735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070b3fe74/0xb72beeaffa1b83f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579577.421106:0:16735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579577.421111:0:16735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579577.421120:0:16735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070b3fe74/0xb72beeaffa1b83f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579577.421139:0:16735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070b3fe74/0xb72beeaffa1b83f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787579577.515912:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:1.0:1787579577.515960:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:1.0:1787579577.515971:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:3.0:1787579577.519236:0:15190:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:3.0:1787579577.519245:0:15190:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787579575 -> 1787579576 00002000:00010000:3.0:1787579577.519247:0:15190:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787579575 -> 1787579576 00002000:00010000:3.0:1787579577.519250:0:15190:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 6147 00010000:00010000:3.0:1787579577.519263:0:15190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c3a2965/0xb72beeaffa1b83e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579577.519275:0:15190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c3a2965/0xb72beeaffa1b83e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579577.519282:0:15190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c3a2965/0xb72beeaffa1b83e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579577.519288:0:15190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba319800 already unused, calling callback (ffffffffc1654230) 00010000:00010000:3.0:1787579577.519304:0:15190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c3a2965/0xb72beeaffa1b83e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579577.519313:0:15190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c3a2965/0xb72beeaffa1b83e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579577.519333:0:15190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c3a2965/0xb72beeaffa1b83e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579577.519341:0:15190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c3a2965/0xb72beeaffa1b83e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579577.519431:0:15190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+18:2359:x1874412591772288:12345-192.168.206.53@tcp:4:dd.0 Request processed in 123503us (123697us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1787579577.519442:0:15190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:3.0:1787579577.519479:0:15190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 3 00000100:00100000:3.0:1787579577.519491:0:15190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+17:2360:x1874412591772672:12345-192.168.206.53@tcp:4:dd.0 00010000:00010000:3.0:1787579577.519522:0:15190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df9b80c4/0xb72beeaffa1b83f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579577.519534:0:15190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579577.519538:0:15190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787579577.519544:0:15190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df9b80c4/0xb72beeaffa1b83f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579577.519555:0:15190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df9b80c4/0xb72beeaffa1b83f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787579577.558867:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:3.0:1787579577.558888:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:0.0:1787579577.561374:0:16735:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:0.0:1787579577.561383:0:16735:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6147 -> 6151 00010000:00010000:0.0:1787579577.561397:0:16735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070b3fe74/0xb72beeaffa1b83f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.561429:0:16735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070b3fe74/0xb72beeaffa1b83f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.561439:0:16735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070b3fe74/0xb72beeaffa1b83f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.561446:0:16735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd82a01800 already unused, calling callback (ffffffffc1654230) 00010000:00010000:0.0:1787579577.561451:0:16735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070b3fe74/0xb72beeaffa1b83f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.561460:0:16735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070b3fe74/0xb72beeaffa1b83f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.561479:0:16735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070b3fe74/0xb72beeaffa1b83f0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.561488:0:16735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070b3fe74/0xb72beeaffa1b83f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579577.561574:0:16735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8f2a5beb-cf32-4efe-802b-47d95029e6c6+15:2360:x1874412591772544:12345-192.168.206.53@tcp:4:dd.0 Request processed in 140538us (154151us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787579577.561588:0:16735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 2 00010000:00010000:0.0:1787579577.561737:0:16734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003271d93f/0xb72beeaffa1b83e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.561756:0:16734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003271d93f/0xb72beeaffa1b83e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.561764:0:16734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003271d93f/0xb72beeaffa1b83e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.561770:0:16734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba319200 already unused, calling callback (ffffffffc1654230) 00010000:00010000:0.0:1787579577.561773:0:16734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003271d93f/0xb72beeaffa1b83e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.561782:0:16734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003271d93f/0xb72beeaffa1b83e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.561792:0:16734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003271d93f/0xb72beeaffa1b83e9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.561800:0:16734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003271d93f/0xb72beeaffa1b83e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579577.561838:0:16734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb46b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+13:2359:x1874412591772416:12345-192.168.206.53@tcp:4:dd.0 Request processed in 153664us (156476us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787579577.561845:0:16734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 1 00000100:00100000:0.0:1787579577.561883:0:16734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 4 00000100:00100000:0.0:1787579577.561894:0:16734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+12:2360:x1874412591772800:12345-192.168.206.53@tcp:4:dd.0 00010000:00010000:0.0:1787579577.561922:0:16734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003de0f713/0xb72beeaffa1b83fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.561974:0:16734:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787579577.561978:0:16734:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787579577.561984:0:16734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003de0f713/0xb72beeaffa1b83fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.561995:0:16734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003de0f713/0xb72beeaffa1b83fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579577.563364:0:16735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:0.0:1787579577.563379:0:16735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8f2a5beb-cf32-4efe-802b-47d95029e6c6+13:2360:x1874412591772928:12345-192.168.206.53@tcp:4:dd.0 00010000:00010000:0.0:1787579577.563414:0:16735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc414cbe/0xb72beeaffa1b8405 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.563428:0:16735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787579577.563432:0:16735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787579577.563438:0:16735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc414cbe/0xb72beeaffa1b8405 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.563450:0:16735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc414cbe/0xb72beeaffa1b8405 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787579577.622378:0:15190:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:0.0:1787579577.622386:0:15190:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:0.0:1787579577.622398:0:15190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df9b80c4/0xb72beeaffa1b83f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.622429:0:15190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df9b80c4/0xb72beeaffa1b83f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.622439:0:15190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df9b80c4/0xb72beeaffa1b83f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.622446:0:15190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0cd82a01000 already unused, calling callback (ffffffffc1654230) 00010000:00010000:0.0:1787579577.622451:0:15190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df9b80c4/0xb72beeaffa1b83f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.622460:0:15190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df9b80c4/0xb72beeaffa1b83f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.622479:0:15190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df9b80c4/0xb72beeaffa1b83f7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.622486:0:15190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df9b80c4/0xb72beeaffa1b83f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579577.622569:0:15190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+17:2360:x1874412591772672:12345-192.168.206.53@tcp:4:dd.0 Request processed in 103076us (215091us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787579577.622578:0:15190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 3 00000100:00100000:0.0:1787579577.622607:0:15190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:0.0:1787579577.622616:0:15190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+16:2360:x1874412591773056:12345-192.168.206.53@tcp:4:dd.0 00010000:00010000:0.0:1787579577.622645:0:15190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdfe8d16/0xb72beeaffa1b840c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.622660:0:15190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787579577.622665:0:15190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787579577.622671:0:15190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdfe8d16/0xb72beeaffa1b840c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579577.622692:0:15190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdfe8d16/0xb72beeaffa1b840c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787579577.623994:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00000001:00080000:3.0:1787579577.680205:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:2.0:1787579577.680611:0:16735:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:2.0:1787579577.680616:0:16735:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:2.0:1787579577.680631:0:16735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc414cbe/0xb72beeaffa1b8405 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.680644:0:16735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc414cbe/0xb72beeaffa1b8405 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.680653:0:16735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc414cbe/0xb72beeaffa1b8405 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.680660:0:16735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9200 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579577.680665:0:16735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc414cbe/0xb72beeaffa1b8405 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.680702:0:16735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc414cbe/0xb72beeaffa1b8405 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.680723:0:16735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc414cbe/0xb72beeaffa1b8405 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.680731:0:16735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc414cbe/0xb72beeaffa1b8405 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579577.680828:0:16735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8f2a5beb-cf32-4efe-802b-47d95029e6c6+12:2360:x1874412591772928:12345-192.168.206.53@tcp:4:dd.0 Request processed in 117449us (273294us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787579577.680838:0:16735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:2.0:1787579577.680879:0:16735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:2.0:1787579577.680891:0:16735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8f2a5beb-cf32-4efe-802b-47d95029e6c6+11:2360:x1874412591773184:12345-192.168.206.53@tcp:4:dd.0 00010000:00010000:2.0:1787579577.680921:0:16735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022c8f1a2/0xb72beeaffa1b8413 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.680974:0:16735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579577.680979:0:16735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787579577.680987:0:16735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022c8f1a2/0xb72beeaffa1b8413 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.681000:0:16735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022c8f1a2/0xb72beeaffa1b8413 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.681548:0:16734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003de0f713/0xb72beeaffa1b83fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.681558:0:16734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003de0f713/0xb72beeaffa1b83fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.681565:0:16734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003de0f713/0xb72beeaffa1b83fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.681571:0:16734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c8e00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579577.681575:0:16734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003de0f713/0xb72beeaffa1b83fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.681583:0:16734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003de0f713/0xb72beeaffa1b83fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.681595:0:16734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003de0f713/0xb72beeaffa1b83fe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.681603:0:16734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003de0f713/0xb72beeaffa1b83fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579577.681638:0:16734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8f2a5beb-cf32-4efe-802b-47d95029e6c6+11:2360:x1874412591772800:12345-192.168.206.53@tcp:4:dd.0 Request processed in 119745us (274132us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1787579577.681647:0:16734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 4 00000001:00080000:3.0:1787579577.721232:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:2.0:1787579577.723503:0:15190:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:2.0:1787579577.723512:0:15190:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:2.0:1787579577.723526:0:15190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdfe8d16/0xb72beeaffa1b840c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.723537:0:15190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdfe8d16/0xb72beeaffa1b840c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.723545:0:15190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdfe8d16/0xb72beeaffa1b840c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.723552:0:15190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba3c9a00 already unused, calling callback (ffffffffc1654230) 00010000:00010000:2.0:1787579577.723557:0:15190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdfe8d16/0xb72beeaffa1b840c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.723566:0:15190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdfe8d16/0xb72beeaffa1b840c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.723587:0:15190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdfe8d16/0xb72beeaffa1b840c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579577.723595:0:15190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdfe8d16/0xb72beeaffa1b840c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579577.723799:0:15190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+9:2360:x1874412591773056:12345-192.168.206.53@tcp:4:dd.0 Request processed in 101170us (316241us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787579577.723810:0:15190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 6 00000001:00080000:3.0:1787579577.759671:0:7670:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:1.0:1787579577.760177:0:16735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022c8f1a2/0xb72beeaffa1b8413 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579577.760193:0:16735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022c8f1a2/0xb72beeaffa1b8413 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579577.760203:0:16735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022c8f1a2/0xb72beeaffa1b8413 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579577.760210:0:16735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ceba319400 already unused, calling callback (ffffffffc1654230) 00010000:00010000:1.0:1787579577.760216:0:16735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022c8f1a2/0xb72beeaffa1b8413 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579577.760225:0:16735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022c8f1a2/0xb72beeaffa1b8413 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579577.760243:0:16735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022c8f1a2/0xb72beeaffa1b8413 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579577.760251:0:16735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022c8f1a2/0xb72beeaffa1b8413 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579577.760353:0:16735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8f2a5beb-cf32-4efe-802b-47d95029e6c6+5:2360:x1874412591773184:12345-192.168.206.53@tcp:4:dd.0 Request processed in 79462us (340224us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787579577.760380:0:16735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 7 00010000:00010000:0.0:1787579578.272822:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579579.060765:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579579.060808:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579579.060834:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579579.060855:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579579.060876:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579579.060894:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579579.060915:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1787579579.060962:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591773568 00000100:00100000:0.0:1787579579.060971:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591773568 00000100:00100000:0.0:1787579579.061017:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591774080 00000100:00100000:0.0:1787579579.061020:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591774080 00000100:00100000:0.0:1787579579.061034:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591773696 00000100:00100000:0.0:1787579579.061036:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591773696 00000100:00100000:0.0:1787579579.061048:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591773952 00000100:00100000:0.0:1787579579.061051:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591773952 00000100:00100000:0.0:1787579579.061067:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 15 00000100:00100000:0.0:1787579579.061087:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1a60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+5:2361:x1874412591773568:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579579.061155:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1a60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+5:2361:x1874412591773568:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 79us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579579.061169:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 15 00000100:00100000:0.0:1787579579.061187:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00100000:0.0:1787579579.061193:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1424700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+5:2361:x1874412591774080:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579579.061219:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1424700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+5:2361:x1874412591774080:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 26us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579579.061225:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00100000:0.0:1787579579.061235:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 17 00000100:00100000:0.0:1787579579.061241:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+5:2361:x1874412591773696:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579579.061262:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8f2a5beb-cf32-4efe-802b-47d95029e6c6+5:2361:x1874412591773696:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 21us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579579.061268:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 17 00000100:00100000:0.0:1787579579.061278:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 18 00000100:00100000:0.0:1787579579.061284:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+5:2361:x1874412591773952:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579579.061303:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+5:2361:x1874412591773952:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 20us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579579.061310:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 18 00000100:00100000:0.0:1787579579.061328:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591773824 00000100:00100000:0.0:1787579579.061331:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591773824 00000100:00100000:0.0:1787579579.061357:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591773440 00000100:00100000:0.0:1787579579.061360:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591773440 00000100:00100000:0.0:1787579579.061381:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 32 00000100:00100000:0.0:1787579579.061387:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+6:2361:x1874412591773824:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579579.061414:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d4886d1-0f39-4e88-a51d-0bd8227c58f4+6:2361:x1874412591773824:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 28us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579579.061427:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 32 00000100:00100000:0.0:1787579579.061439:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 33 00000100:00100000:0.0:1787579579.061445:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0cec1427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+20:2361:x1874412591773440:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1787579579.061483:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0cec1427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f2a5beb-cf32-4efe-802b-47d95029e6c6+20:2361:x1874412591773440:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 38us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579579.061489:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 33 00000100:00080000:0.0:1787579579.061516:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787579579.061520:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787579579.061522:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787579579.061913:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412591773312 00000100:00100000:3.0:1787579579.061919:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412591773312 00000100:00100000:3.0:1787579579.061983:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 123 00000100:00100000:3.0:1787579579.061990:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ce88250c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+13:2361:x1874412591773312:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1787579579.062022:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ce88250c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006d1ed3-2214-4ba1-a0e0-c1e7e674e492+13:2361:x1874412591773312:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 32us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579579.062028:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 123 00010000:00010000:3.0:1787579579.296250:0:16123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787579579.301535:0:16773:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:3.0:1787579579.872222:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787579579.872246:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0ceb46b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616917120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787579579.872325:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579579.872571:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874412616917120 00000100:00100000:1.0:1787579579.872579:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874412616917120 00000100:00100000:1.0:1787579579.872649:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787579579.872659:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ceb480ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616917120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787579579.872694:0:15188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787579579.872751:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ceb480ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874412616917120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579579.872758:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787579579.872864:0:14496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787579579.873173:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0ceb46b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3320:1874412616917120:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787579580.325237:0:14488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29345 lines, 29345 kept, 0 dropped, 0 bad.